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Symposium: Toward the Development of More Comprehensive ^ 
Sets of Personality Measures 
Harry H. Harman, Chairman 

Introduc t ion 

The idea for preparing these Proceedings developed in the course 
of the actual Symposium. In addition to the formal parts of the Symposium, 
comments and questions were made by more than a half-dozen members of the 
audience and were discussed by the symposium participants. Unfortunately, 
members of the audience were not Identified; questions were spontaneous 
and there was no recording equipment. To try to recapture from memory 
alone the questii^ns and discussions would not do juscice to the lively 
give-and-take that ensued, and hence it was deemed more advisable to leave 
out that part from these Proceedings. 
r;eneral Remarks 

Tliis Symposium focuses on some problems and issues in the assessment 
of human personality traits. It approaches the problem of measuring individual 
differences from a broad tlieoretical basis and illustrates this approach with 
empirical findings. Both the conceptual and measurement aspects are subjected 
to critical appraisals. 

As a point of departure, this symposium was planned around a research 
activity lieing conducted by ^,TS , with the partial assistance of ONR. 'hat 
activity is trying to provide a service to researchers who are working (through 
the use of factor analysis) toward a theoretical basis in the personality 
domain. Such a service, in the form of a reference kit of tests, has existed 
for some time in the aptitude area. In the present work of extending this 
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service to a nart of the personality domain it is imnc^rtant tliat it be 

iudged in the perspective broad personal.itv struct wre theories. 

I 

Such perspective is introduced in th*:^ fjrst paper hv ('-oldhor.t: who 
lavs a generaJ theoretical, foundation and indicates how measures f cm* the 
structural constructs of such a th^^orv of personality are being developed. 
This is followed by two papers stemming out of the I'TS project: (1) The 
first, by French, presents the. techni cal "Identification" c^f personality 
factors from a car'^ful review of the literature and a rationalization of 
the problems and inconsistencies encountered; (2) the second, by Per men, 
adds the empirical testing of the hvpothesl 7.od personality factors. The 
final paper, by Cattell, provides a set of criteria or standards for good 
programmatic research — without which progress toward an eventual tlieory of 
personality would be elusive. 

In the limited time available for this symposium we shall have to 
follow the restrictive format of having the four papers that are its nucleus 
presented without interruption, followed by bri^f commentaries from the two 
formal discussants. Dr. Fiske and Dr. Royce » and then it will be open for 
discussion from the floor. At a luncheon meeting of the symposium participants 
there was general agreement on the time required for each of the presentations, 
so that we hope to have 15-25 minutes available, and we do hope that you will 
want to enter into the discussion. 



The F.xnloitation of the English Lanpua^e 
for the Development of a Descriptive Personalitv "r^axonomv 

T.ewis R. ^'Oldherg 
University of Dre^ion and ^reeon Research Institute 

Perhans iihe most fundamental — and certainly the most ambitious — eoal cff 

personality research is the identification of the most important individual 

differences in mankind. These* cent ral individual differences, as distilled 

from the enormous variety which are manifested, should provide the structural 

♦ 

constructs for an eventual theorv of personalitv, as well as the targets for 
the development of new personalitv measures. V/liile attemnts have lonR been 
made to systematize personalitv differences, t])e most promising of the empir- 
ical approaches to this enormous task have been based on one critical assump- 
tion: namely, that those individual dlff erences tihat are of the mo s t sisn i — 
f icance in ^h_e daily transactions of persons with each o th;fr will eventually 
become encoded into the na tura 1 language as single-word trait descriptors 
(Goldberg, 1972). 

The first serious attempt to exploit the natural language to construct 
a comprehensive per L;ona 11 1 v taxonomv w^»s carried out by Raymond Cat tell, v^ho 
noted that: 

. . the first source — and the only immediatelv practicable 
one — for a * total realm* of personality traits is to be found in 
language. Over the centuries, hv the press\ire of urt^ent neces- 
sity, every aspect of one human being^s behavior thrt is likelv 
to affect another has come to be handled by some verbal symbol — 
at least in any developed nioder:i language. Although some new 



words for traits constantly appear, a (^ehris pauiv.ilpnt btit 
obsolete words constantly falls f ron the Innf^uaeo ffattell, 
1957; p. 71]." 

. . by contrast, the area of the personal itv which does- 
not bear on other people, which deals with tho physical world, 
and in a way not relevant to the interests of society, will he 
sparsely and incompletely ponulated vn'th trait terms. If chairs 
and autoTDobiles and cheeses had tongues, we should doubtless 
find trait terms •for light and heavv sitters, for a wide variety 
of »ear changers, and for the varying* behavior of digestive organs 
The trait vocabularies of modern languages, therefore, may be 
expected to cover, with reasonable completeness and efficiency, 
patterns and elements of behavior as seen from the standpoint 
of man, but not as seen from the standpoint of nature [Cat tell, 
1943; p. 4861." 

"The position we shall adopt is a very direct one . . . 
making only the one assumption that all aspects of human person* 
allty which are or have been of Importance, interest, or utility 
have already become recorded In the substance of language. For, 
throughout history, the most fascinating subject of general dis- 
courae^ and also that In which It has been most vitally neces* 
sary to have adequate^ representative svmbollsm> has been human 
behavior. Necessity could not possibly be barren where so little 
apparatus Is required to permit the birth of Invention [Cattell, 
1943; p. 4831." 
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Allport and Odbert (1936) called 3ome 18,000 person-descriptive terins 
from Webster* s Second Unabridged- D_ i ct:iouarv and grouped them into four lists: 

(a) a set of metaphorical or doubtful terms; two sets of terms referring to 

(b) social evaluations and (c) temporary states; and, finally, (d) some 4500 
terms that they deemed were descriptive of "real personal traits." Recently, 
the original Allport-Odbert list of trait descriptors has been expanded and 
updated by Warren Norman, on the basis of a comprehensive survey of We b s t e r * s 
Third Unabridged Dic tionary. Norman has sta*:ed that: 

"The basic commitment which underlies this research effort 
is that the eventual construction of more effective theories 
of the development, structure, and functioning of personality — 
and the formulation of more adequate procedures for the selec- 
tion, classification, and evaluation of personnel — will be 
facilitated by having av.?ilable a well-organized and extensive 
vocabulary by means of which to denote phenotypic attributes 
of persons. Tt is also assumed that the eventual development 
of psychome t r ical Iv adequate methods and devices for the assess- 
ment of personality characteristics will bt. markedly aided by 
the availability of a comprehensive and clearly articulated 
taxonomy of trait descriptive terms [Norman, 1^67; p. 1]." 
Each of the 18,125 terms in Norman's new pool has been classified bv 
• his research team either into one of 11 "inclusion" or into one of 5 "exclu- 

sion" categories. A brief summary of this initial catalogue is presented 

4 

in Table 1. Less than 3000 (or about 15%) of the 18,125 terms appear to 

Insert Table 1 about here 
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refer to stable traits (e.e., "meek"), anc^tlu^r 3000 to tepoornrv states or 
activities (e.g., "lonesome"), and rou^hlv half that nu!^b«.M- (about ]'~^nn tt-rn^^O 
to social roles, re\at ionsiiips, or effects (e.i.*, "daneerous") . Apnrc^x ir-a t el v 
60% cf the total collec:tion can be ^Mowod as dross, either becausi^ f^u^ terras 
have only minimal descriptive s i en i f i cauf^ e nr because thev are so arraiu^, 
ambiguous, vague, metaphorical, c^r obscure that their nei sono 1 oi^ i ca 1 irnl i~ 
cations are available onlv to the most fanatic of 1 o>:i coe raphe rs . 

Table 2 presents a more detailed breakdown of Norman rataioeuc^, 
including an analvsis of the 300 items in Cnuf^h's popul.^r Adjective Check 
Lis t (ACL). Roughlv 807 of the ACL items were classified as\stable traits 
by the Norman team, while 7% were classified as temporary states. In teres t inv^ v. 

Insert Table 2 about here ^ 

over 8% of the ACL terms were assigned to one of, Norman's exclusion cate- 
gories, most on the grounds that they were personological ly ambiguous (e.g., 
dull, mature, weak). 

For the past few years, the assessment team at Oregon Research Institute 
has been collaborating with Dr. Norman on this taxonomic venture. Our goal 
is to develop a compelling structure — or a set of equally-compelling alter- 
native structures — independently for each of the three major '^inclusion'' 
pools (Traits [I], States [11], and Effects [TIT]), and then tc relate the 
constructs in these three taxonomies both to each other and to structures 
based upon other types of stimuli (e.g., the more complex — albeit more tra- 
ditional — personality inventory items that were used in the ETS taxonomy 
project). Finally, we intend to replicate at least the most alluring find- 
ings from this long-term endeavor using other natural languages (including 

O 
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some non Indo-European languages such as Turkish and Hebrew). 

To date, we have concentrated our attention on those terms which refer 
to stable traits (Category I in Table 1). Each of these terms has been admin- 
istered to samples of university students (each sample composed of 30 males 
and 50 females) to determine its ambiguity and/or definitional difficulty, 
its social desirability, and its applicability (or endorsement frequencies), 
both in self-description and in peer description (Norman, 1967) . On ♦''ic 
basis of. these and other data, the set of 3000 terms has been f^und to be 
easily prunable; approximately half of the initial set terms are extremely 
difficult even for the college educated. Consea '^ntly we begin the taxono- 
mic gameplan with around 1500 players; Warren Norman has attempted to clus- 
ter a set of 1566 tenuis, and I have been working with a somewhat expanded 
pool of approximately 1700. 

Ultimately, we will have generated a family of competing structures, 
from which we — and others — will be able to select th^ mrst compelling. Some 
of these initial structures will be hierarchical in form, others will be 
dimensional; that is, we will be employing both hierarchical clustering and 
factor analytic algorithms. The structures will be generated from four major 
sources: (a) judgments of similarity of word meaning, (b) analyses of lexi-- 
cographic materials (e.g., the Synonym Finder ), (c) self-ratings, and (d) peer 
ratings. Competing structures will be evaluated in terms of their similar- 
ity across these four data sources. We will consider a structure as compelling 
if (a) it is aesthetically pleasing, (b) it is intuitively logical in the 
light of known facts about the domain, and (c) several sensible methods con- 
verge on that same solution. 
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Since most psychol o.^ist s have at least some rout^h idea of the procochires 
involved in obtaining struct -.ires via factor or r lust or nnalvses of seU" and 
peer ratings, T will focjs primarily on those that we are p,eneratinp hv less 
conventional means. TlUs aspect of the research problem m.iv he re f c^rnni ] a t ed 
in the following terms: Given what we think ve know about laivuiatre — snocifi- 
cally about the semantics of personality trait terms — can we annlv any psvolio- 
linguistic principles in order to make our taxonomic task nnre manageable?' 
Or, alternatively, can we use our existing knowledge in t>Ms realm to heln 
generate an initial taxonomv, against which the empiiical structures can 
then be compared? 

The most intriguing kind of answer to these Questions has come from 
the efforts of Dean Peabodv at -Swarthmore College to unconfound the influences 
of evaluation and description in uersonalitv trait attribution. Peabody's 
theoretical scheme is based on the assumption that, in the natural languap-e, 
there exist sets of interrelated trait-terms which are used to describe dif- 
ferences in the intensity or the frequency of the same basic behavioral pat- 
tern. For example, consider individual differences in "generosity" (or, 
alternatively, in possessiveness with regard to one's monev and property). 
While one can use adverbs to scale these differences (e.g., "very generous," 
"quite generous," "a bit generous," etc.), one can alternatively use single 
terms which embody such differences in degree (e.g., "generous," "philan- 
thropic," "lavish," "extravagant," "wasteful"). 

Moreover, for niany types of behavioral patterns, it appears that there 
is an important relationship between the extremity of the behavior described 
and the rated social desirability of the trait-descriptor. Specifically, 
more extreme terms are typically judged as less desirable (e.g., it is good 
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to be "gerierous," but it is bad to be "too p,enerous" or "over-generous" or 
"extravagant''). For some — but not all — bphavioral patterns, it is possible 
to find four types of trait-descriptive terms, and these are illustrated in 
the top portion of Fable 3. Some terms are used to describe persons manifesting 
a "proper" amount of a trait, X, while others are used to describe persons 

Insert Table 3 about here 

manifesting a "proper" amount of the antonym of X, or Y, Moreover, we can 
also often find terms used to describe persons who are judged too extreme 
in either direction. To return to our original example, "generous" and 
"thrifty" can he viewed as describing two positions on the "generosity vs. 
possessiveness" continuum, "generous" beint> eood and X-ish, "thrifty" being 
good and Y-ish. Thus, we can now scale four terms on this continuum: "over- 
generous," "generous," "("hrifty," "over-thrifty." Alternatively. one might 
substitute^ the terms: "extravagant," "generous," "thrifty," and "stingy." 

TabK' 4 presents this basic paradigm as T have been using it to classify 
some 1700 trait desc I - i ive terms. Tn the top part of the table, you can see 

Insert Table 4 about here 

the illustrative trait descriptor "hippity" and its antonym "hoppity," both 
of which are evaluated positively. The opposite, or negation, of "hippity" — 
that is, "unhippity," "nonh ippi tv, " "inhippity," "hippitvless, " etc. — will 
typically he reversed, both descriptively and evaluatively, and thus can be 
found in the opposite corner of the table, Near that same location will be 
terms that describe an excess of "hoppityness" — that is, "overhoppl ty" cr 
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"hyperhoppity . " All of these terms make up a nuclear trait cluster: the 
original root word, plus all its synonyms: antonvms of the root v;ord and of 
the synonyms (plus the synonyms of the antonyms); all reversals of these terms; 
all terms which denote varyin.g positions on the same trait, especinllv those 
that denote too much ("over-") or too little ("under-"), of the trait; and 
all synonyms and antonyms of the latter terms. 

In Table 4, this scheme is applied for fun to one of the most potent 
of traits: PASSION. Terms denoting various degrees of passion — from vir- 
tually none at all ("passionless," "dissensualized") to even more than enough 
("lecher ;^s," "lewd") are ordered in the table by their average social desir- 
ability. These mean values, on a scale from 1 (least- desirable) to 9 (most 
desirable), are based on the ratings from 50 male and 50 female college stu- 
dents (Norman, 1967) . Terms that denote an excess amount of the trait are 
listed a bit to the left of the root terms, while terms denoting the reversal 
of root terms are offset a bit to the right. In this and subsequent tables, 
a line is used to separate the desirable terms (mean values from 5 to 9) from 
the undesrrable ones (mean values from 1 to 5) . As you can see, it is ter- 
ribly bad to be either "lecherous" or "passionless," quite bad to be either 
"lustless" or "unchaste,*' not so desirable to be either "unvoluptuous" or 
"overpassionate, " good to be either "voluptuous" or "chaste," and best to be 
either "amorous** or *'unadulterous . " The example in Table 4 is presented more 
for its prurience than for its typicality. In fact, the example includes a 
quite unusual word pair, **lustful" and *'lustless," both of which have low 
desirability values. In general, a root word and its reversal are quite dis- 
similar in evaluation — this being one of the rare exceptions. 
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Let us turn now to a less zany sort of nuclear trait cluster, namely 
the one I have already used as an example. Table 5 shows the application of 
the schema to the concept of "j<enerositv; terms indicating a propensity 

Insert Table 5 about here 

for giving or sharing are listed on the right, those suggesting a propensity 
for retaining are listed on the left. As one moves down the page, from the 
top to the bottom, the terms become increasingly less desira|>le. Note that 
the word set is not completely balanced or symmetrical: there are no terms 
to express frugality with quite the same degree of desirability as are the 
opposite terms '"generous" and "charitable." And, there are no terms to 
express an excess of generosity with quite the same degree of iindesirabili ty 
as the opposite term, "greedy." That is, the concept of generosity, as it 
Is embedded in the English language, is somewhat confounded with evaluation, 
although it can be unconfounded by an appropriate selection of terms from 
the nuclear trait set. Most traits show at least some s '^h confounding, with 
far more terms in two diagonal cells (e.g., upper left and lower right) than 
in the other two cells (e.g., upper right and lower left). Tndeec*, there are 
unfortunately, some concepts that are so completely confounded with evalua- 
tion that they include only terms in two diagonal cells. For example I know 
of no single English word to express the notion of too much intelligence 
("overintelligent") . 

Table 6 presents another preliminary nuclear trait cluster, namely the 

Insert Table 6 about here 

propensity for taking risks. Risky terms are listed on the right, while 
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cautious ones are listed on the left. Mote that there are plentv of "over-" 
terms (e.g., "overcautious," "overbold"), all of then unciesirahlc. And,, orct 
again, there is a slight confounding with evaluation: there are far tnore 
positive tenrs to express riskiness than to express cautiousness: to he "care- 
ful" is to be very good, but not quite as good as it is to be "coiiratyoo/is ; " 
and, to be "overrash" is to be quite bad, hut not quite as terrible as it is 
to be "cowardly." 

Table 7 illustrates the application of this schema to one of the most 

Insert Table 7 about here 

central concepts In personality research, namely Self-confidence or Self- 
esteem. Self-esteem is an example of a construct with differential variance In 
the desirability of terms defining each of its two poles. Specifically, it is ^ 
desirable to be "confident," "self-respecting," or "assured," while it is 
very undesirable to be "blgheaded," "boastful," "swellheaded," or "stuck-up." 
In contrast, the range of desirability values for the "humble" pole of this 
construct ("self-critical" to "prideless") appears to be considerably less 
extreme. Moreover, this schema could help to unravel some of the seeming 
Inconsistencies In past research on the sel^-concept • For, as Table 7 should 
make clear, there are at least two distinct varieties of self-esteem; (a) some 
persons tend to endorse the terms on the right (e.g., "self-confident," "ego- 
tistical") while others tend to endorse the ones on the left (e.g*, "humble," 
**self-deprecetlng") ; and (b^) some persons tend to endorse the terms above the 
line (e.g., "humble," "self-confident"), while others tend to endorse the 
ones below It (e.g., "self-deprecating," "egotistical"). The former are 
saying that they are confident (or not) In a content-consistent manner; 
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different Indices of self-esteem Include differential amalgams of these two 
processes » they should serve to produce Inconsistent empirical findings* 

Table 8 illustrates an application of this schema to a related construct, 
Culture. This example of a cluster, with which I am far from satisfied, can 

^ Insert Table 8 about here 

be used to illuminate some of the problems we confront in developing an intui- 
tively-based structure. First of all, once again we encounter a confounding 
with evaluation: there are many more terms to describe a highly evaluated 
and well-socialized person (e.g., "tasteful," "mannerly," "poised," "relined," 
"suave," "urbane") than to describe a highly-evaluated but less-cultured one 
(e.g., "earthy"). Moreover, terras in the bottom right hand comer of Table 8 
(e.g., "snooty," "snobbish") appear to be alarmingly similar to those terms 
in the same section of Table 7 (e.g., "affected," "vain," "conceited," "swell- 
headed"). In fact, one such term, "stuck-up," keeps wandering back and forth 
between the two clusters. 

Finally, Table 9 presents the terms which scale the concept of Reli- 
giosity, illustrating the application of the schema to a concept typically 
treated as an attitude rather than a more global personality trait. Even 
here, there is a slight asymmetry vis-a-vis evaluation: there are more terms 

Insert Table 9 about here 

to denote a positively-regarded religious person than to denote a positively- 
regarded atheist. On the other hand, for this demension, like that of Mascu- 
linity-Femininity, one has to interpret those social desirability mean values 
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wlth caution: religious persons evaluate the religious words much more highly 
than non-religious persons, just es males evaluate the male-related terms 
(e.g., "masculine") more highly than do females. The range of desirabilitv 
values presented Ln Table 9 is attenuated by the fact that two quire distinct 
types of persons are mer>,ed together. 

Table 10 presents a summary of the 47 initial clusters Included in this 

Insert Table 10 about here 

preliminary, and still very roughcut, taxonomic scheme* Some of the largest 
clusters should probably be further subdivided, among them being Assertiveness 
(134 terms). Spirit (100 terms). Temper (96 terms), Honesty (74 terms). Cul- 
ture (74 terms). Conscientiousness (70 terms). Risk-taking (^6 terms). Impulse 
Control (65 terms), and Self-esteem (60 terms). Some of the smallest clusters 
may eventually be merged together, for example Introspection (15 terms) and 
Contemplation (13 terms), Analyticalness (9 terms) and Objectivity (13 terms), 
and perhaps even Percept iveness (17 terms) and Foresight (13 terms). Clearly, 
we still have a long way yet to go, and this summary is but a promissory note 
against our future efforts. Hopefully, however, this brief report may en- 
velgle a few adventurous travelers to join us along the way. 
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TABLE 1 

The Initial Catalogue of 18,125 English Words 
(after Norman, 1967) 





Number 


% 


Example 


I. Stable ("Biophysical") Traits 


2797 


.15 


Meek 


II. Temporary States or Activities 


3021 


.17 


Lonesome 


III. Social Roles, Relationships, or Effects 


1476 


.08 


Dangerous 


(Total: I, II, and III) 


(7294) 


(.40) 




1 

Exclusion Categories 








(a) Almost purely evaluative 


760 


.04 


Nice 


(b) Anatomical, physical, or medical 


882 


.05 


Hairy 


(c) Ambiguous, vague, or metaphorical 


4796 


.26 


Oceanic 


(d) Obscure; little-known 


3606 


.20 


Severing 


(e) Other; miscellaneous 


787 


.04 




(Total excluded) 


(10,831) 


(.60) 





Source : Norman, W. T, 2800 personality trait descriptors: Normative 
operating characteristics for a university population . 
Department of Psychology, University of Michigan 5 
Unpublished Technical Report; April, 1967. 

(See also: Allport, G, , £ Odbert, H. S. Trait-names: A psycho- 
lexical study. Psychological Monographs , 1936, 47 
(1, Whole No. 2lim 
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TABLE 2 

A Classification of the .300 Terms in Cough's Adjective Check List (ACL) -21 
According to the Rubrics Used by Norman to Refine his Initial Pool of 18,125 Terms 







No. in 
Category 


No. 

ACL 


of 
Terms 


ACL Examples 




Category 1 
Prime terms 


608 


(31) 


192 


(6U%) 


calm , quiet , Wise 


ox aJL>Xe 

♦'Biophysical" 
Traits 


Category 2: 
Difficult terns 

.Cateppry 3: 

Slangy, quaint, 
awkward or colloquial 


5UU 


v3%) 

V 3 * ^ 


6 
38 


(2%) 
(13%) 


autocratic, frivolous, stolid 
cool, sexy , zany 




Category 3*^ : 
Excluded terms 


787 


(u%) 


2 


(1%) 


conservative, rattle-brained 




Category U 

Prime terms: States 


. 384 


(2%) 


15 


(5%) 


confused, gloomy, tense 


Temporary 
States and 
Activities 


Category 5: 

Prime terms: Acti^^ities 

Category 6: 
Difficult terns 


583 
399 


(3t) 
(2%) 


1 


(1%) 


demanding, praising, quitting 
despondent 




Category 7: 

Slangy, quaint, 
awkward or colloquial 


1655 


(9%) 


1 




anxious 




Category 8: 

Prime terms: Roles 


242 


(1%) 


1 




dominant 


Social Roles » 
Relationships ^ 
and Effects 


Category 9: 

Prime terms: Effects 

Category 10: 
Difficult terms 


163 
163 


(It) 
(1%) 


3 
0 


(1%) 


attractive, charming, humorous 




Category 11: 

Slangy, quaint, 
awkward or colloquial 


908 


(5%) 


0 








Category 12: 
Evaluative terms 


760 


(u%) 


6 


(2%) 


capable, foolish, peculiar 


Exclusion 
Categories 


Category 13: 

Phvsical n*»dical. Or 
grooming terns 

Category lU : 

Ambiguous or meta- 
phorical terms 


. 882 
1*796 


(S%) 
(26%) 


5 

lu 


(2%) 
(5%) 


handsom.e, healthy ^ strong 
dull, mature, weak 




Category 15: 

Very difficult or 
obscure terms 


360G 


(20%) 


0 






Total 




18,125 


(100%) 


288" 


(96%) 





*Twelve tcriTs, in the ACL are not included in Korir.^n's Master Li::t: clear- thinking, defensive, egotisti- 
cal, interests narrow, interests broad, opportuni'.tic , organized, peacoablc, pleasure-seeking, self- 
punishing, unaffected, and unrealistic. 



TABLE 3 

Scheme for Unconfoundihg Evaluation and Description 
(after Peabody, 1957) 



Descriptive Attribute 

Evaluation Non-X 

Positive (+) Thrifty Generous 

Negative (-) Stingy Extravagant 



Relative 
Incidence in 
the Population 



Pole A 




Pole B 



Descriptive Attribute 
(e.g.. Tendency to share one's possessions) 



Source : Peabody, D. Trait inferences: Evaluative and descriptive aspects. 

Journal of Personality and Social Psychology Monograph , 1967, 7 
{n^ Whole No. 6Ui*). 



TABLE U 

Application of the Scheme to the Classification of the 
Set of Trait- Descriptive Adjectives 

The Basic Paradigm; 
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Hippity 



Unhoppity 
Ovejshippity 



Evaluation 

(high) Hoppity 
-(neutral)— 



Unhippity 
(low ) Overhoppity 



An example; PASSION 



Unadulterous 



Chaste 



Virginal 



Mean 
Desirability" 

6.6 
6.6 
6.il 
6,0 
6.0 
5,9 
5.8 
5.7 
5.M 



Amorous 
Passionate 

Sensual 
Sexy 

Voluptuous 

Sensuous 

Lusty 



Unvoluptuous 



Insensuous 
Lustless 
Strait-laced 

Puritanical 
Prudish 



Dissensualized 
Passionless 



4.9 

4.2 
4.1 
3.8 
3.8 
3.8 
3.7 
3.5 
3.5 
3.4 
3.2 
3.0 
2.9 
2.8 
2.6 
2.5 
2.2 



Flirtatious 
Overpassionate 
Sultry 

Hot-blooded 
Hypersensual 

Unchaste 
Lustful 



Overlusty 



Lewd 

Adulterous 



Lecherous 



Average social desirability scale value, on a scale from 1 (least desirable) 
to 9 (most desirable), based on the ratings from 50 male and 50 female 
college students (Norman, 1967). 
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Economical 
Thrifty 

Unwasteful 

Frugal 

Unextravagant 



TABLE 5 

GENEROSITY 

Mean 
Desirability 

7.8 
7.8 
7.1 
7.0 
6.7 
6.6 
6.5 
6.0 
5.7 
5.4 



Generous 
Charitable 
Unniggardly 



Philanthropic 



Uranercenary 



Possessive 



Closefisted 

Unphi lanthrop i c 

Mercenary 

Covetous 

Miserly 

Uncharitable 
Niggardly 

Ungenerous 
Stingy 
Greedy 
Overgreedy 



4.8 
4.7 
4.2 
3.9 
3.8 
■3.8 
3.6 
3.3 
3.2 
3.1 
2.9 
2.7 
2.4 
.'.4 
2.3 
2.2 
2.0 
1.7 



Lavish 
Overcharitable 
Unthrifty 

Un frugal 
Extravagant 
Uneconomical 

Thriftless 

Wasteful 
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RISK-TAKING 






Mean 








Desirability 






8.0 




Courageous 




mm M 

7.6 




Brave 


Careful 


W9 la 








7.3 




Venturous 




7.2 




Venturesome 




7.1 




Adventurous 




mm A 

7.0 




Stout-hearted 




7.0 




Fearless 




7.0 




Valiant 




7.0 




Gallant 


Heedful 


6.9 




Heroic 


Prudent 


6.9 








6.7 




Daring 


Cautious 


6.7 




Spunky 


D.D 




Lion-hearted 




6.5 




Dauntless 




6.5 




Unfearing 




6.2 








6.2 




Valorous 




6.0 




Bold 




5.9 




Gutsy 




5.9 




Forward 


Wary 


5.6 








5.^ 




Devil-may-care 




"♦.5 




Impetuous 




H,5 


Overvaliant 




4.5 




Saucy . 




4. If 




Headlong 


Unheroic 


U.2 






Unbold 


4.2 




Uncautious 


Tentative 


4.2 


Overbrave 




4.1 




Aweless 


Overcaroful 


4.0 




Brash 


Overwary 


4.0 




Unwary 




4.0 


Overdaring 




3.9 




Audacious 




3;8 




Incautious 




3.8 


Overbold 


Overcautious 


3.7 




Nervy 


Unvaliant 


3.6 




Coc)<y 


Timid 


3.5 




Timorous 


3.5 






Ungallant 


3.4 


Overforward 


Unventurous 3*0 




Imprudent 




3.0 




Foolhardy 


Overfearful 


2.9 




Rash 


Unadventurous 2 • 9 




Brazen 


Weak-hearted 


2.8 




Reckless 


Weak-kneed 


2.8 








2.6 


Overrash 


Gutless 


2.3 






Cowardly 


2.0 







TABLE 7 
SELF ESTEEM 
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Mean 




Desirability 






8.1 


Confident 






Self-respecting 




/ • o 


Self-reliant 




7.7 


Self-confident 






Assured 






Self-sufficient 




7.1 


Self-assured 


Self-critical 


7.0 




Unvain 


6.9 




Unboastful 


6.8 




Conceitless 


5.8 


U'iiselfconsci( 


Humble 


6.7 


Proud 


Nonegot i s t i cal 


6.7 






6.5 


toshy 




6,2 


UnbashfUl 


Unpres\ming 


6.0 


Self-satisfied 


Unassuming 


5.7 




• Boastless 


5.7 






5.6 


Unmeek 





4.7 


Self-righteous 






Complacent 


Self-conscious 






Self-doubting 


U.3 




Shy 


4.2 




Basihful 


4.2 




Ovennodest 


4.1 


Self-possessed 




'4.0 


Self-important 


Meek 


3.9 




Self- d isparaging 


3o8 






3.7 


Overconfident 


Self-effacing 


3.5 


Egocentric 


Unassured 


3.U 


Oversure 


Unsure 


3.3 


Immodest 


Insecure 


3.2 


Egotistic 


Self-deprecating 


3.2 




Unconfident 


3.1 


Self- centered 




3.1 


Pretentious 




2.8 


Overproud 




2.8 


Affected 


Prideless 


2.7 


Vain 




2.6 


Conceited 




2.6 


Smug 




2.5 


Bigheaded 




2.4 


Boastful 




2.3 


Swellheaded 




2.0 


StucV--up 



TABLE 8 



■ CULTURE 





Hean 




Desirability 






8.0 


Civilized 




7.8 


Tasteful 




7.5 


Cultivated 




7.4 


Mannerlv 




7.4 


Poised 




7.4 


Cultured 


Dovm-to-earth 


7.0 


Polished 






Dignified 


Unpretentious 


6.8 


Chic 




6.7 


Debonair 




6.5 


Refined 




6.5 


Sophisticated 




6.3 


Suave 




6.2 


Cosmopol i tan 




6.1 


Courtly 


Earthy 


5.9 






5.7 


Unprovincic 




5.7 


Urbane 


Homespun 


5.2 






4.7 


Patronizing 


Provincial 


4.5 




Unsophisticated 


3.9 






3.7 Overre fined 




3.6 


Condescending 


Unpolished 


3.U 


Blase 


Undignified 


3.3 




Unpoised 


3.2 






3.1. 


High-faluting 




3.1 


Pompous 


Uncultivated 


3.0 




Untasteful 


2.9 




Unrefined 


2.8 




Uncultured 


2.7 






2.6 


Haughty 




2.6 


Stuffy 


Untnannered 


2.5 




Uncivilized 


2.5 




Vulgar 


2.4 




Course 


2.4 




Tasteless 


2.4 




Uncouth 


2.3 




Boorish 


2.2 


Snooty 




2.0 


Snobbish 



Worldly 
Worldly-minded 

Earthly-minded 



TABLE 9 

RELIGION 

Mean 
Desirability 

6.6- 
6.5 
6.3 
6.1 
6.0 
5.7 
5;3 
5.2 
S.l 



Religious 

God-fearing 

Spiritual 

Reverent 

Devout 

Saintly 

Mystical 

Other-worldly 



Unsaintly 
Undevout 
Unreligious 
Unspiritual 
Materialistic 

Impious 
Nonreligious 
Heretical 

Mundane 

Nonspiritual 

Irreligious 

Godless 
Profane 

Irreverent 
Blasphemous 



k.9 
If. 8 
U.7 
«f.6 
4.5 
I+.3 
■4.2 
4.0 
3.9 
3.7 
3.6 
3.5 
3.4 
3.3 
3.2 
3.0 
2.7 
2.7 
2.3 



Pious 

Worshipful 



Unworldly 
Ultraspiritual 



Ultrareligious 



TABLE 10 
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The Number of Terms in Each of the Preliminary Sets 



• • C6n3ti>uct 

1* Risk Taking 

2. Spirit 

3. Inipulse Control 
Self Esteem 

5* Predictability 

bI Loyalty 

Assertiveness 

7* Aggression 

8* Envy 

9* Self Indulgence 

10* Generosity 

!!• Nurturance • 

12. Friendliness 

13* Trust 

14* Criticalness 

15* Dogmatism 

16* Respect 

17* Warmth 

18* Temper 

19* Speaking Style 

20* Gossip Proneness 

22* Verbosity 

23. Sarcasm 

25. Nervousness 

26. Toughness 
27* Neatness 
28* Honesty 

29. Activity Level 

30. Ambition 

31. Conscientiousness 

32 . Culture 
33* Religion 
34* Passion 

35 . Introspection 

36 . Contemplati on 

37 . Analyticalness 
38* Objectivity 
39. Perceptiveness 
40* Foresight 

41* Curiosity 
42* Versatility 
43. Originality 
44* Depth 

45. Intelligence 

46. Achievement 
47^ Gender 
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48 . Unclass if i ed 
(Values) 
(Maturity) 
(Conservatism) 
(Transparency) 
(Other) 



A- 




B+ 
















18 


5 


21 


22 


66 


'33 


6 


48 


13 


100 


18 


23 


14 


10 


65 


16 


11 


14 


19 


60 


3 


3 


4 


8 


IB 


4 


0 


3 


0 


7 


26 


25 


23 


60 


134 


6 


7 


3 


34 


50 


0 


7 


0 


20 


27 


3 


4 


2 


7 


16 


13 


6 


5 


8 


32 


10 


0 


24 • 


4 


38 


32 


0 


21 


0 


53 


8 


2 


8 


9 


27 


2 


13 


. 5 


32 


52 


1 


16 


0 


15 


32 


30 


0 


20 


0 


50 


18 


1 


16 


5 


40 


14 


30 


6 


46 


96 


10 


14 


11 


8 


43 


2 


3 


2 


9 


IB 


9 


1 


3 


8 


21 


0 


0 


1 


16 


17 


0 


1 


3 


22 


26 


15 


1 


14 


3 


33 


5 , 


0 


6 


11 


22 


37 


4 . 


27 


6 


74 


14 


1 


15 


5 


35 


16 


3 


11 


4 


34 


33 


0 


29 


8 


70 


26 


4 


28 


16 


74 


16 


3 


9 


5 


33 


8 


3 


8 


11 


30 


3 


1 


8 


3 


15 


3 


0 


8 


2 


13 


4 


1 


3 


1 


9 


3 


3 


5 


2 


13 


8 


0 


9 


0 


17 


4 


0 


9 


0 


13 


10 


0 


.8 


3 


21 


1 


0 


3 


0 


4 


5 


0 


6 


1 


12 


8 


0 


b 


0 


13 


9 


0 


7 


0 


16 


15 


0 


10 


1 


26 


4 


5 


3 


4 


16 


523 


207 


488 




1679 










29 



(8) 
(4) 
(4) 
(5) 
(8) 
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The Identification of Personality Factors From A 
Systematic Review of The Literature 

John W. French 

We have Just been shown how It has been possible to extract a broad 
set of personality dimensions for human beings from a scrutlnlzatlon of the 
language of personality that human beings have developed over the centuries. 
Now let's carry that logic through another step. Rather than spotting a 
wide coverage of personality dimensions, vre are now going to look more speci- 
fically at those personality dimensions that have been tested and Identified 
as factors. To do this, we will scrutinize the factors that researchers have 
published, mainly In Journal articles. The personality Items or scales used 
as variables In these analyses are quoted or described, albeit sometimes 
rather briefly or carelessly; they are Intercor related and factored by a 
variety of methods; and the resulting factors are Interpreted by the authors 
In the light of particular hypotheses, special backgrounds, or In Individual- 
ized settings that happened to have been used In former analyses by the 
same Investigator. Ah! That's the perplexity that arises so often! One 
factor analyst finds repeatedly that Items A and B always load on factor C. 
Another finds again and again that Items X and Y always load on factor Z. 
Each one chortles about the splendors of factorial Invarlance, the delights 
of consistent results, and the seemingly obvious conclusion that there could 
be no other possible Interpretation of this Important niche within the domain 
of personality. However, the reader who has seen both reports feels less Joyful 
about consistency and Invarlance. Item A Is pretty much like Item X, and Item 
B Is pn tty much like Item Y, but not quite. Factor C Is pretty much like 
factor Z, I think, but I wonder If the college students used as subjects In the 
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first analysis read the same meanings into items A and B that the prison 
inmates, for example, saw in iterrs X ^nd Y. There are a lot of fuzzy variables 
here being influenced by a lot of furry conditions. I guess I have to kick 
myself a little for ever looking down on clinical diagnoses just because I 
thought they lacked scientific rigor. There is not much rigor involved in 
trying to combine findings in the factor analysis literature. More identical 
sets of variables should be used in more analyses along with new variables. 
That's what this Kit is all about. 

Now I will outline the procedures in the literature search, and then 
I will take you right along with me into a few of the more difficult decisions 
or interpretations that we have had to make in the course of formulating 
hypotheses with regard to the variables that would best represent the variables 
in the literature and the factors that those variables will be most likely 
to load when used in new analyses* I like to call this a process for arriving 
at a consensus of the literature. 

The literature is big but irregular in quality » content, and relevance 
to this project. Therefore, we had to recognize three limitations to our 
survey as follows: 

Limitation No. 1: The factors of interest are those that concern 
reasonably general temperamental traits of human beings. Cognitive factors 
are being handled separately. "Non-cognitive** is a term that is a little too 
broad for us, because we are not going to cover psycho-motor or physical char- 
acteristics, and we only plan to cover Interests and values in so far as they 
help to measure temperamental traits. Interest factors are simply too numerous 
and too Interlocking. There Is also a rather large literature on human traits 
that are too specific for our purposes. Sometimes It Is difficult to separate 
articles about such traits from those that are pertinent for us, because both 
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will often appear together. We can use evidence about general traits » but 
we have left out such things as: kinds of reaction to human pain, influences 
on the recognition of facial expressions, behavior patterns among teachers 
in the classroom, responses to various kinds of conflict situations, and 
kinds of behavior demonstrated under hypnosis. 

Limitation No. 2: The factors of interest to us are those found in 
noraal subjects rather than in psychiatric patients. Admittedly, this is a 
limitation of convenience. Certainly there are some psychologists who con- 
sider, say. Psychotic Tendency to be a more important factor than many of 
the factors we will include. However, it will be omitted, because it has not 
been established with any subjects other than psychiatric patients. A kit 
of self-report questionnaires is likely to be most usable with normal persons. 
Besides, it would take a person with clinical or psychiatric experience to 
interpret properly the factors that are special to psychiatric patients. I, 
for one, don't have that experience. A substantial number of studies have 
obtained data from both psychiatric patients and normals. Such studies are 
being cover*?d in our survey unless the proportion of normals is so small that 
the results do not fit the results for normal subjects. For example, Andrew 
Comrey has made many analyses of the M>tPI, using a mixture of subjects that 
comprised more than 50 percent patients in a mental hospital. These studies 
have been included in the survey, since they do contain much information about 
normal temperamental factors. 

Limitation No. 3: The factors of interest to us are those that are 
found in adult populations or in young people down to the age of about 12 years, 
Xany workers from Thurstone on have noted that factorial patterns differ with 
age. Particularly, it has been noted that, as compared to adults, children in 
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the primary grades have less differentiation among factors or fewer factors, 
partly, no doubt, because such young subjects are unable to respt>nd to the 
finer shades of meaning in tests or questionnaires. Also, our sponsor, the 
Office of Naval Research, is naturally concerned with ages 19 and up. 

With these limitations considered, we are planning to include in the 
Kit of reference variables several markers for each factor that has been 
"established" in the literature, A factor will be regarded as established if 
what seems subjectively to be the same factor is found in at least three analvsc?; 
by at least two different laboratories. This criterion for establishment tray 
sound rather lenient, but we do want to include as many factors as possible 
that may become important in the future. It is precisely those factors that 
are not yet well established* which are in most need of research by users of 
the Kit. 

We have made no particular point in counting the number of articles in 
the literature that we have considered, used, or spurned, but a few numbers 
will help to describe the general scope of the project. A multilithed mono- 
graph put out by me at EiS in 1953 rather fully described 68 analyses, all of 
which yielded factors representing reasonably general traits of human temper- 
ment. Just 4 of these used child subjects; 8 used mainly hospital inmates. In 
the literature since 1953, 77 factor analyses concerned with human tempera- 
mental behavior were discarded as being limited to special people or special 
situations. 20 articles used isalnly p^sychiatrlc patients; 19 used child sub- 
jects. Only about 10 had a methodology or rotational technique that rendered 
them impossible to compare usefully with the bulk of the articles. Limitation 
because of methodology was as moderate as this, because the many confusions 
in factorial results come from variation in the kind of variables included and 
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in arbitrariness or instability in the rotational process, rather than in 
the actual statistical models used in guiding either factor extraction or 
rotation. For example, whether the rotation is orthogonal or oblique seems 
to make relatively little difference, while the introduction of just one 
variable can change the picture considerably. This left 110. 

Now let's take a look at the ^'established" factors that this survey 
has spotted. The Handout lists these factors in alphabetical order, by the 
symbols we have given them, allowing what is usually considered to be the 
favorable pole to come first. The items that loaded on each of these 
factors in many analyses were Inspected, and an attempt was made to put 
these items into several logical categories. These categories of items 
are named or described in the Handout. They constitute hypothesized marker 
scales for the factors. Perhaps they can be regarded as hypothesized subf actors, 
from which the listed first-order factors would appear In a higher order 
analyses. Diran Dermen, the next speaker, will discuss the results of our 
tryouts aimed at confirming or refuting these hypotheses. 

Let mo now pick out a few of the situations that required the more 
difficult ('ecisions or interpretations that led to the item scales described 
in the Handout, the ones that we have Included in our tryouts. Prior to 
assembly of the Kit, some of these will, of course, be changed or deleted as 
a result of new evidence as to the correctness of our hypotheses, which were 
generated by the literature* 

Here is a typical problem where different analyses published in the 
literature seem to be covering different but overlapping aspects of what might 
most reasonably be described as a single first-order factor. My example is 
Factor Se, Sensitive Attitude. As we see it, this is Dr. Cattell's factor 
O called Premsia vs. Harria, Factor I. His Factor I, as seen in the 16 P.F. 
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Questionnaire represents the item categories labelled C and D in the Handout. 
Both of these are interests: one in people's welfare and the other in 
esthetics. This factor in the 16 P.F, does include a few items on emotional 
sensitivity like those in the Handout's category B, but the 16 P.F. factor 
does not seem, to me to cover category A at all. Comrey and Duffy (1968), on 
the other hand, have a factor they call ^'Empathy'* that loads short item scales 
for helpfulness, generosity, sympathy, kindness, interest in people, and 
service to others. These items seem to include categories A and C, possibly 
B. Adcock and Adcock (1967) have a factor called '^Corapassion*^ , which includes 
fondling fluffy kittens, the pricking of one's conscience, sensitivity to 
sadness, and avoidance of hurting people's feelings. This also seems to 
cover categories A, B, and C. I could go on like this: some factors in 
the literature have categories A and B, some have B and C, and some have 
only one of the categories listed. No published study that I know of contains 
all four kinds of variables, and yet, if one did, there is enough evidence 
available to support the hypothesis that all four categories would load a 
single first-order factor. 

Continuing my discussion of the factor j Sensitive Attitude, I wil] now 
talk about the Masculinity-Femininity factor. You can't find this one in the 
Handout, because we omitted it, despite its having been found many times by 
many laboratories. We attempted to reflect this factor as seen in the liter- 
ature by writing four categories of items, as follows: 1,. Tough-minded, 
unemotional vs^. sensitive, sympathetic, gets upset. 2. Accepts dirt and 
nature vs_. cleanly, fears creeping animals • 3. Interest in masculine hobbies 
vs . Interest in feminine hobbies. 4. Interest in Masculine careers vs . 
interest in feminine careers. Well, you can see that this is little more than 
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a rewording of the categories under Sensitive Attitude. There are two 
categories concerned with emotional sensitivity and two concerned with in- 
terests. No analyses show these two factors side by side with any degree 
of clarity. Cattell (1950) comes closest to this with factors he called 
"Emotional sensitive self-sufficiency vs_. gregariousness^' and "Masculinity- 
Feminity", but, in that analysis, neither of these factors is clear enough 
to be convincing. At the other extreme, when Ford and Tyler (1952) analyzed 
variables from the Terman and Miles Masculinity-Femininity Test , they 
divided the area into two factors: Emotionality and Interests. Therefore, 
by including both of these kinds of items in the single factor that we are 
calling Sensitive Attitude, we are making the assumption that Ford and Tyler 
over determined the first-order domain, and, by so doing, they separated it 
int-j subfactors or what we would choose to call markers for one first-order 
factor that is sometimes called "Sensitivity" and sometimes called "Masculin- 
ity-Femininity". A caution to researchers needs to be made here. Since the 
sexes will differ markedly on either the four categories of items listed 
under Sensitive Attitude or any four categories that might be correctly listed 
for Masculinity-Femininity, the variance for these variables and their inter- 
correlations will be greatly increased for studies using subjects of both 
sexes, as opposed to subjects of a single sex. Interpretations should be made 
accordingly. Actually, in the literature both factors Se and M-F have been 
named with both mixed subject groups and with single-sex subject groups. 

In the next sample of a difficult decision that I am going to describe, 
we are hypothesizing, not the addition of extra concepts to one of Cattell 's 
factors as we * did with Sensitive Attitude, but the breaking down of one of 
Cattell' s factors into two factors. I refer to his scale G, which he has 
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called "Super-Ego Strength" and which is called "Conscientious v£. Expedient" 
in the 16 P*F. Subjective logical categories for the items in that 5?cale ar^ 
the three that are listed in the Handout under Morality and also the three 
that are listed under Persistence. There is, indeed, some logic as to why 
Morality and Persistence might properly be combined. If one's conscience 
or super-ego is strong, one is likely to adhere to high morals and also to 
persist in one^s duties or ideals of behavior • There is also rather obvious 
logic in separating Morality from Persistence. 

Here is some of the factorial evidence: In Cattell and Gibbons (1968) 
a short scale called "persistent effort'* was highest loader on a separate 
factor from one that was dominated by a scale called "lack of moral restraint". 
Sells et al (1970), on the other hand, seem to confirm Cattell 's combining 
of these areas into one factor, since they separated no morality factor, but 
did rather clearly show Cattell's G and Guilford's "Cultural Conformity" to 
fall on a factor they call "Conscientiouseness". Guilford's Cultural Con- 
formity actually combines elements of both "irrational peristence" and "law- 
abiding morality". In addition to what looks like a valid logical distinction 
to us, several Separate appearances of each factor seem significant. For 
Morality: Item categories of types B and C were found by Adcock and Adcock 
(1967) on a factor called "Ego-ideal". Howarth and Browne (1971) had a factor 
they called "Conscience" that included items in categories B and C and possibly 
A. Warr, Lee, and Joreskog (1969) called "Virtuous self-denial" a factor 
that seemed limited to category C. Persistence was found without the concept 
of morality three times prior to 1953. Also, Barratt's factor (1965) called 
"Impulsiveness" has items like those listed as B and C under Persistence, plus 



-47- 



the concept of "thinking before I act". Cattell and Gibbons (1968) called 
their factor that loaded "persistent effort" "Self-sentiment Control, Q^'S 
a factor regarded by Cattell as distinct from his Factor G. All of this is 
certainly conflicting, but it did seem safest to make separate marker scales 
for each factor and find out whether the factors would separate in our 
tryouts . 

Here is another problem: In the case of the factor General Activity, 
there is some question as to whether plain rapidity of movement (category A) is 
part of the same factor as being busy and accomplishing things (categories 
B and C). Guilford's tests, GAMIN and G-Z Temperament Survey , have a scale 
that contains items from all three categories. On the other hand, Jernigan 
and Demaree (1971) have two factors: "General Activity", which only includes 
rapidity of movement, and a separate factor they called "Industriousness". 
Using lists of adjectives as variables, Scioruino (1969) separated two factors; 
one he called "Quickness", the other he called "Energy", which included such 
words as energetic , dynamic , active, and vigorous. In this area particularly, 
words can be misleading. The word, energy. Is very ambiguous, sometimes 
referring to pure physical activity, sometimes to mental or social activities, 
and sometimes to either or both. In Cattell*s studies the closest factor to 
this one is Surgency, a combination of enthusiasm, talkativeness, and excitement 
loving. Sells et al (1970) confirmed that Surgency is separate from General 
Activity. Our decision was to keep Surgency separate, but to consider rapidity 
of movement as being on the same factor with energy, in the sense of being busy 
and accomplishing things. We believe, then, that Jernigan and Demaree and 
Scior.-ino overdetermined the area, and so separated the first-order factor 
General Activity into two subf actors. 
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Now look at the factor called Res*:raint vs. Rhathymia. This has three 
categories of items: A. Planning vs. impulsive, B. Responsible vs. caiefrte, 
and C. Eiijoys stability v£. wants excitement. All three categories of items 
appear in scale R of Guilford's Inventory of Factors STDCR and the Guilford- 
Zimmerman Temperament Survey . Catrell and Gibbons (1968) have a single factor 
that loads a brief Rhathymia and a brief Carefreeness scale. Adcock and 
Adcock (1967) have a factor called **Ego control" that has items in categories 
A and B. Barratt (1965) found category C items on a factor he called *'Risk 
taking". Comrey and Soufi (1961) bring together categories B and C. This 
all makes Restraint v£. Rhathymia look reasonably solid, but listen to this: 
Butt (1970) has a factor called "Social concern vs. emotional indifference", 
item categories B and C, and he has a separate factor called "Impulse control", 
which seems to contain A cand C. Howarth and Brovme (1971) have separate 
factors they call "Impulsiveness", with very clear category A items, and 
Rhathymia" wi- i very clear category B items. Even Guiltord and Guilford (back In 1939) 
had a rather interesting hint of this situation. They found a good Rhathymia factor 
with all three item categories, but they also found a separate weaker factor 
whose highest loadings were made by the impulsive items, although the magnitude 
of these loadings was less than those for the same items on the Rhathymia factor. 
All in all, it seemed wise for us to regard the separate Rhathymia and Impulsive- 
ness factors as instances where overdetermination of the space gave rise to 
subf actors, and so we are making the hypothesis that the negative of impulsiveness 
is a part of the first-order factor. Restraint vs. Rhathymia. 

After setting up the list of factors that are established in the literature 
by our definition and after defining each one by actually writing new items in 
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each of the several categories that might be used as markers for these factors, 
it became uncomfortably apparent that there was an occasional category oi items 
on one factor that was remarkably similar to one of the categories of items on 
another factor. It was a kind of fascinating game, then, to inspect side by 
side every possible pair of item category in the entire list, and to assign to 
each of these pairs an estimated coefficient of correlation, sometimes negative, 
usually rather low^ but sometimes very high. This generated a hypothetical matrix 
of intercorrelations among all item categories. If a real matrix turned out to 
be like this one and was factored, &.iy high correlations between categories of 
items on disparate factors would prevent the appearance of factors that had been 
established in the literature. To juggle around the categories very much so as 
to aiaximize the success ot our hypotheses would be a procedure inconsistent with 
our central purpose, which was to reflect the findings of many researchers. 
However, we did scrutinize this hypothetical matrix of intercorrelations in 
order to make use of it as an additicnal subjective check on our interpretations 
of factors in the literature. What we actually did was to eliminate from the list 
of iLem categories just a few categories that seem particularly prone to produce 
factors that would straddle the ones that seemed established by the literature. 
Following are a couple of examples. 

Look at the three categories under dominance. There used to be a fourth. It 
was called ''Superior, confident socially vs. self-conscious, unsure". This was 
originally included under Dominance, because it was a part of some of the 
Dominance factors in the literature. However, it had high estimated correlations 
with some of the categories under two other factors: Sociability and Poise. 
Therefore, we simply left out this category under Dominance. Thus, our factor 
of Dominance, as it stands in the Handout, does not include what might be called 
social dominance. A check of the literature does not always confirm such decisions 
as this one. For example, Guilford and Zimmerman (1^56) have a Dominance factor, 

^ which they call "Ascendance". It is loaded by an item about social leadership, 

IC 

ifeiBiffii and that same item about social leadership also loads on a separate factor that 
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they call "Sociability" • However, it seemed wise to purge our Dominance factor 
of sociability variance anyway. 

Here is another example of a big estimated correlation between item cate- 
gories. In the Handout there are three categories under Sociability. However, 
inspection of sociability factors in the literature originally led us to in- 
clude a fourth category called "Gregarious, Likes being with people vs. likes 
solitude, limits friends". It is apparent that a scale of such items would 
correlate highly with a .1 three of the categories being proposed for the factor 
Gregariouseness . A reirspection of the literature only partly confinr-s the 
idea of omitting gregarlousness items from the factor Sociability. Actually, 
at least four analyses do clearly contain both of these factors side by side, 
although there are some anlayses that combine the two factors into one. When 
both factors do occur, the gregariousness items sometimes have loadings on both. 
Our own studies will have to supplement the evidence on this question. In the 
meantime it certainly would not maice sense for us to hypothesise that a gregar- 
iousness marker would stick with Sociability in the same analysis that contains 
the three markers you see in the Handout for the separate factor of Gregariousness. 
Therefore, our factor of Sociability must refer to actual social interaction, 
while Gregariousness refers merely to people being physically in one another's 
presence. We need research on this. It is a research question, hut probably 
a rather arbitrary one to decide whether Gregariousness is a subfactor or marker 
for Sociability or whether it is a separate factoi. in what we must rather 
arbitrarily decide is the first-order factor domain. I wish I could end at least 
one speech without yearning for more research, but I can't I 
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Factor Ac: General Activity 



A. Moves rapidly, quick in physical performances vs_. slow 

B. Busy, active in projects or (non-social) affairs v^. uninvolved, gets 
overburdened 

C. Accomplishes things rapidly vs. indolent , unmotivated 



Factor Ag: Agreeableness 



A. Interested in people's welfare, helpful vs . prefers making lone 
intellectual contributions 

B. Cooperative, supportive, forgiving vs_. irritated by people, vengeful 

C. Adaptable, tends to agree, submissive vs_, negativistic, domineering, 
aggressive 

D. Trustful, confides in people vs^. suspicious, keeps distance 

E. Friendly, likeable, outgoing vs. aloof, unpleasant, withdrawn 



Factor Al: Alertness 



A. Alertness to immediate surroundings , attentive vs. lui aware , engrossed , 
deep in thought, absent minded 



Factor Au: Autistic Tendency 



A. Daydreams vs . has practical thoughts 

B. Anxiety and worry that leads to autistic thinking vs^. relaxed, adjusted, 
realistic thoughts 

C. Bothered by daydreams or autistic distractions vs. enjoys these things 



Factor Ca: Calmness vs. Anxiety 



A. Relaxed, stable, at ease vs^. anxious, worried (about self), edgy, uneasy, 
nervous ; tense , restless (without cause) 

B. Takes time to think, deliberate vs. overreacts, impulsive, jittery 
Cc Confident about the world vs . having fears or worries about outside 

inf lue .ices 



Factor Co: Concentration 



Concentration on study or reading, restraint leading to mainLenance of 
attention v^. mind wai^ders, bored, forgets names 



Factor De: Dependability 



A. Likes rules, follows plans vs . likes freedom of choice, likes change 

B. Dependable, punctual, keeps promises vs . careless about promises and details 

C. Self-sentiment control, control of own feeli\igs vs . actions and thoughts are 
swayed by emotions 



Factor Do: Dominance 



A. Takes charge socially, wants power vs . submissive, willing to serve 

B . Egoistic , pushes own ideas v£. respects others ' ideas , self-effacing 

C. Rights-conscious, complaining vs. tolerant 



I ERIC 



-54- 



Factor E: Emotional Stability 



Av Emotionally stable*, tolerant, stolid vs . emotionally sens:.tive, irritable 

B. Optimistic, laces problems vs_. worrying, dwells on problen»s, escapist 

C. Healthy, feels viperous, vs_. tired, intermittent loss of energy, 
hypochondriacal 

D. Life is good, life is worthwhile vs. feels frustrated, dissatisfied 

Factor Em: Emotional Maturity 

A. Patient, adjusts to frustration v£. verbally aggressive, demanding 

B. Modest, shuns attention, outwardly directed vs . self-centered, seeks 
attention , egotistical 

C. Satisfied, ccjperates with authority vs^. asserts independence from 
authority , stubborn 

Factor Gs: Gregariousness 

A. Likes to be with people physically vs. likes to be alone 

B. Interest in occupations with people vs ■ interest in occupations iSv.'l.Ht «i 
from people 

C. Likes work or socializing with people vs^. likes work alone or isolated 
activities 

Factor Me: Meticulousness 

A. Meticulous, orderly, neat, careful, particular about personal effects 
vs . messy, careless, impulsive 

Factor Mo: Morality 

A. Law-abiding, obedient, well-mannered, patriotic vs. free progressive, 
liberal 

B. Moral, knows right from wrong, resists temptation vs_. pleasure seeking 

C. Generous, helpful, fair, gives to causes _vs^. selfish, uncharitable 

Factor Na: Need for Achievement 

A. Likes to do his best, works hard, persists until successful vs_. play 
before work 

B. Likes success in competition, likes getting ahead vs . dislikes competition 

C. Strives for accomplishment, wants to produce something great v£. no 
motivation to do good or to help people 

Factor 0: Objectivity vs. Paranoid Tendency 

A. Objectivity and fairness attributed to others vs . paranoid delusions 
about others 

B. Credit is given by others vs . blame by others is unfair 

C. Depends on others for help, advice, and sympathy vs. not interested in 
others , independent 

Factor Cm: Open-Minded vs. Authoritarian 

A. Believes many different philosophies (religious or political views) can 

be reasonable v s^. rigid belief in one philosophy, no tolerance of compromise 

B. Respect for and interest in the religious and political philosophies of 
other people vs . strong belief in the rightness or wrongness of principles 

C. Innovative, readiness for new ideas, flexible, foresightod vs . highly 
conservative, conventional, and unchangeable in ideas 
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Factor Pe: Persistence 

A. Persistent, persevering, determined v£. quitting, fickle, needs change, 
gets discouraged 

B. Likes stable tasks, interests are stable vs . likes changing tasks, 
interests change 

C. Conscientious, careful, exacting, tidy, orderly vs* relaxed, carefree, 
nonchalant 

Factor Po: Poise vs_. Self-Consciousness 

A. Enjoys group attention, exhibitionistic , poised vs_. dislikes being in 
front of people 

B. Enjoys performing in public, feels pride in speaking to a group vs • 
dislikes performing in public 

C. Seeks comment and attention from important people vs^» self-conscious 
with superiors, avoids criticism 

Factor Re: Relaxes vs^. Nervous 

A. Physically relaxed vs • fidgets, has nervous habits, twitches, has 
restless movements 

B. Tolerant of physical, non-4iuman or situational annoyances vs_. irritated 
by mishaps and frustrating circumstances 

Factor Rt: Restraint vs_. Rhathymia 

A. Planning vs^. acting without thought, impulsive 

B. Serious, responsible vs^> lively, carefree, irresponsible, no thought of 
the future 

C. Enjoys stable pursuits vs * w^nts excitement, change, wildness 

factor Sc: Self-Confidence 

A. Feels confident physically, personally, and career-wise vs. needf-; 
encouragement, feels inferior, afraid of failure 

B. Claims to have abilities, skills, and good experiences vs. claims 
handicaps, ineptitude, and unfavorable <ixperiences 

C. Perceives others as having been positive toward him vs , negative 

Factor Se : Sensitive Attitude 

A. Warm, soft, cooperative, kind, considerate vs . hard, stem, bossy 

B. Emotionally sensitive, empathic, delicate, quiet vs. robust, noisy, 
active , tough , fearless 

C. Interest in people's welfare, religion vs. interest in people for 
companionship or fun 

D. Interest in imaginative ideas, music, esthetics, literature vs_. interest 
in practical, technical, political, and economic ideas 

Factor So: Sociability 

A. Competent socially, social organizer, enjoys attention vs^. withdrawn, 
fears public speaking and social responsibilities 

B. Glib talker, has superficial social know-how vs . aloof, doesn't know 
or care what should be said 

C. Hardened socially, confident in social contacts vs. shy, socially insecure 
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Factor Ss : Self-Suf f iciency 

A. Self-sufficient, likes to be alone in stress, in planning, in lacing 
problems, makes own plans, dislikes being served, self-reliant, decisive 
vs . dependent, needs help from others, group dependent 

B. Desires to be different, individualistic, free vs_. needs approval r'' 
others , conforms , accepts social order, agrees with group , likes 
affiliation , complies 

C. Unusual ideas, unconventional, idealistic, reflective vs . has majori y 
opinions, tends to have same feelings as others 

D. Emotional independence vs_. needs love, friends, succoran^\e, and prorecc^f?. 

Factor Su: Surgency vs. Repression 

A. Exuberant, enthusiastic, cheerful vs. repressed, reserved, inhibited 

B. Likes to stimulate and cheer up people vs. quiet stay at home 

C. Talks without inhibition, expressive, frank vs. cautious in talking, 
precise , secre tive 

Factor T: Thoughtf ulness 

A. Likes to think, reflect, meditate vs . prevented from doing it by social 
or business activity 

B. Likes to think about people or with people vs . enjoys the company of 
people without analyzing them 

C. Thinks about self vs. carefree about self 

D. Intellectual interests vs. active interests 

Factor To: Tolerance of Human Nature and Things vs . Criticaluess 

A. Naive, impunitive, believes people are honest and fair vs . believes peopJe 
lie and are unfair to gain an advantage 

B. Believes people are capable of good work vs ^ critical, fault finding 

C. Tolerant of human nature vs_. cynical about human nature 

D. Tolerates or respects people vs_. feels hostility (convert, not overu) 
against people or groups of people 

E. Tolerates the imperfections in things vs . feels hostility toward things 
that fail to work 

Factor Wb: Well-bfiing vs . Depression 

A. rlas feeling of well«-being, happy vs , depressed, blue, lonely 

B. Hopeful, it>i:erested in life vs^. fear and worry about doom or vague dangers 

C. Confident, can stand criticism vs. guilt prone, feels worthless and 
spurned, worries about himself 
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A Verification Study of 28 Self-Report Personality Factors 

Diran Dermen 
Educational Testing Service 

John French has summarized the results of his review of the literature. 
My job is to describe the results of an attempt to verify 28 factors he judged 
to be established. The 28 factors were broken down into what were judged to 
be relatively distinct components — from one to five per factor. The components 
(John has used the term subfactor) numbered 87 in all. Short 12 to 16 item sub- 
scales were written to fit each of the 87 descriptions. You will recall that 
each component was described bipolarly. Equal numbers of positively and nega- 
tively keyed items were written to loark each pole. Thus, we started off with 
balanced subscales; balanced in terms of true-false keying and in terms of the 
two defined poles. 

The more than 1300 items we had written along with the 20 items of the 
Social Desirability scale from Jackson's Personality Research Form were ad- 
ministered to recruits at the Naval Training Center at San Diego. More than 
4000 men were tested in a complex design that divided the battery into 30 over- 
lapping booklets such that no individual was required to respond to more than 
320 items, but which also permitted the determinat ion of the relationships 
among all 87 subscales. 

It had been intended to administer the items in the usual fashion but we 
discovered in the first session that a large proportion of the sample could not 
finish the booklet i.n the allotted time. The decision was then made to read all 
questions aloud. (A new sample took the first battery under the new conditions.) 
Incidentally, Dr. Goldberg has administered our battery to college students in 
^ the normal manner. We will have his data for comparison. 
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Four hundred cases who had omitted no items were randomly selected and 
item analyses were performed* Items having contamination-corrected blserial:-. 
less than .15 or pass-percents less than ,10 or greater than .90 were elimin- 
ated. In addition, items were eliminated to maintain balance in the number of 
true- and false-keyed items. Reliabilities (coefficient alphas) were obtained 
for the refined subscales on a new sample. Ten of the 87 subscales were eliriin-' 
ated in these two steps. The retained subscales ranged in length from 4 to 16 
items. Their reliabilities ranged from .35 to .79. 

The remaining 77 subscales were intercorrelated and a Minimum Residual 
Fac'cor Analysis performed* Based on Kaiser's criterion of the number of roots 
greater than one, 23 factors were retained and rotated to oblique simple structure 
using the Direct Ob limin^ program and deltas of 0 to .40. Upon examination of 
the hyperplane counts and the apparent interpretability of the results, the most 
oblique solution was retained and will be reported on here. It should be added 
that the degree of obliqueneocs is still not high, with the highest intercorrela- 
tions among factors being only .36. The amount of variance accounted for by the 
23 Minres factors is approximately 78 percent of the total variance. Communalities 
ranged from .38 to 1.00. 

It might be noted that the postulation of 28 factors would have argued for 
the retention and rotation of 28 factors. However, examination of the correla^ 
tions among subscales for particular factors argued against the retention of 
all 28. I will now discuss our results, which, while not being as confirmatory 
as we would have liked, are interesting. 

In the Handout are presented the factor pattern weights and the factor 
structure correlations for all 23 factors. The descriptions and abbreviations 
for the subscales are the same as those in John French's Handout (at least they're 
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supposed to be). In general, only variables with pattern weights greater than 
or equal to .30 are listed. If a variable had sizable weights on a factor or 
factors other than the particular factor being presented, the "extraneous" 
weights are given in brackets after the description of the variable. The last 
listing for each factor gives the Social Desirability weights and correlations. 
These were extended into the already determined rotated factor space. It will 
be noted that the weights are quite low; a function of the fact that Social 
desirability variance is spread throughout most of the matrix. The Social De^ 
sirability correlations > on the other hand, vary from -^37 to .60. 

At the top of the first page of the Handout is presented Factor VIII, 
clearly identifiable as Self-Conf idence . All three of the markers designed 
for this factor appear with sizable weights. They include self-confidence in 
physical, social, and intellectual areas. The additional markers with small 
weights also make sense. Note that there is a sizable correlation with the 
Social Desirability scale. 

Factor XII, Gregariousness , appears at the bottom of page 67. The 
two Gregariousness markers, both of which involve liking to be with people as 
opposed to liking to be alone, appear on the factor. The B subscale for 
Gregariousness, an attempt to measure interest in gregarious occupations, failed 
at the item analysis level and was not included in the factor analysis. The 
appearance of the B subscale for Objectivity on the factor seems to imply some 
need of people for moral support and the other two, the A subscale for Persist- 
ence, and subscale B for Need for Achievement, may imply the function of the 
group as a standard of reference. 

Open-Mindedness , Factor IX (which appears on page 68) is a very clear 
factor with all three intended markers appearing. The large loading for 
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Tolerance and the other loadings imply general opennesss, trust, and a degree 
of flexibility. We had origxnally defined the factor in opposition to autliOL- 
itarianism but that seems too loaded a description for the negative pole. 
Alt'aough iVi not getting a payoff froni Rokeach, I ^11 settle for clo^^ed-mind- 
edness for the negative end of tlie factor. 

Factor Two on page 69 is a fusion of Poise and Sociability. All of the 
markers for the two appear. They include aspects of enjoyment of attention 
as well as social competence and social confidence. The negative end of the 
factor appears to be self-consciousness or shyness; perhaps aloofness. 

1 actors III and V, which appear on page 70, present an interesting and 
clear splitting of the four Self-Sufficiency markers into distinct factors. 
Factor III is clearly a kind of emotional self-sufficiency; an ability to 
cope with problems alone. Factor V appears to be a more intellectual kind 
of self-sufficiency, perhaps best characterized by the terms non-conformity 
or unconventionality . Incidentally, the correlation between the two factors 
is .20. 

On page 71 we are again presented with a splitting of a single expected 
factor into two fairly distinct and at least moderately clear factors. Factor 
VI is reasonably interpretable as a kind of thinking about the outside world, 
the usual kind of "liking thinking." I have taken the liberty of coining the 
phrase "extraspective" to describe this factor. I trust there is at least one 
among you who will forgive me. Factor XXII with a very large weight for 
"Thinks about self" and liking to "think, reflect, meditate" appears intro- 
spective in nature. The two factors correlate only .18. 

Factor I, appearing on page 72 is the largest among the rotated fac- 
tors. It is described as calm, relaxed vs worried, nervous. It might also 
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be characterized as anxiety. Two markers for aach of the Calmness, Autistic 
Tendency, Dependability, and Well-Being factors appear. If fewer factors 
had been extracted one would be tempted to characterize It as Indistinct from 
the commonly found second-order anxiety factor. Its direct contribution to 
the variance of the factor ensemble Is only about 8%, Perhaps more refined 
subscales or a more oblique solution would permit separation of the component 
marking this factor. It Is rather highly correlated with Social Desirability 

Factor IV on page 73 Is, as you see, labeled Restraint in recognition 
of the appearance of the two markers for that factor. It might just as 
easily be characterized as planful and serious vs. carefree. 

Factor XVII, labeled Perslstence-Metlculousness should have been 
labeled simply Metlculousness . Subscale C for Persistence is clearly more 
meticulous than persistent. Subscale B for Persistence, "Likes stable tasks. 
Interests are stable'* defines a specific factor uncorrelated with this one. 
The small loading for autistic thinking lends a slight flavor of compulsive- 
ness. 

On the next page. Factor XVI, Moral vs. Hedonistic, is character- 
ized by pleasure-seeking both in activity and in fantasy. It seems to be 
clearly defined. Its hedonistic aspect appears more clearly than does its 
morality aspect. 

The ^'Adjusted to Society" Factor seems quite clear. I was tempted to 
label it "Jack Armstrong." The array of Morality, Objectivity, Emotional 
Maturity, and Tolerance do nothing to dissuade me from this interpretation. 
Its relatively low correlation with social desirability may say something 
about what ±s_ socially desirable in today's society. 
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Factors VII and XIII on page 75 are not particularly clear. Both 
have markers for Dominance, but note the opposite-signed weights for the B 
subscale for Relaxed vs. Nervous, "Tolerant of physical, non-human, or situ- 
ational annoyances." Of the two factors, the first seems less fuzzy. 

On page 76 of the Handout, Factor X, there is an omitted variable. 
Subscale C of the Restraint markers "Fnjoys stable pursuits vs. Wants excite- 
ment, change, wildness" should have a weight of .33 and a correlation of .A6. 
Unfortunately, it messes up the "Optimistic about People" interpretation of 
the factor, unless perhaps the negative side of the subscale implies a need 
to escape from people or the world. (See, if you work hard enough, anything 
fits.) With the possible exception of the Restraint variable, the factor 
description does seem appropriate. The factor is correlated ,36 with Factor 
I, Calm, Relaxed vs. Worried, Nervous. 

Factor XXIII is characterized by moderate loadings for Calmness, Sensitive 
Attitude, and Tolerance subscales. "Gentleness" is not an entirely satisfactory 
description but it's close. 

Factor XVIII on page 77 has only one large weight but all of the 
small weights fit the "Energetic, Vigorous" interpretation. This factor could 
be validated on Hubert Humphrey. 

Factor XIX appears to be a fairly specific factor characterized by 
helpful concern for other people's welfare. 

The remaining four factors, XI, XIV, XV, and XX, seem to me to be 
specifics and most siir)t>ly interpretable in terms of the subfactor description 
associated with each. I won't take time to discuss them. 

So, where are we? It seems to me that the present study verifies a 
number of John French's conclusions on the existence and the nature of the 
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factors: Self-Conf idence, Gregariousness and Open-Mindedness are completely 
clear. We were not at all surprised by the fusion of Poise and Sociability. 
The splits of Self-Sufficiency and Thoughtfulness both seem sensible. Our 
so-called anxiety factor worries me a bit. Could we have split it into com- 
ponents more in line with what we expected? 

Meticulousness seems now to be clearly established, but where has Persis- 
tence gone? Perhaps it will prove to be as elusive as are replicable, construct- 
validated measures of rigidity. Perhaps persistence occurs in the service of 
other more salient traits. 

I am uncomfortable with ;:he factor labeled Restraint. Its markers 
seem too discrepant. The only one of the remaining factors that seems at least 
close to what we expected is our "Energetic, Vigorous" factor which has two 
markers for General Activity and other aiarkers consonant with an "energetic" 
interpretation. 

Why not more success? We probably could have done Procrustes rotation 
and had more positive results. Perhaps our factors are not oblique enough. 
(We will try to get a more oblique solution.) Perhaps we are lousy itera 
writers. Perhaps the ten discarded subscales were critical. Does oral admin- 
istration of the items account for anything? Whatever limitations the study 
does have, I've found the results to be surprisingly interpretable. 

One last point. While pride might dictate otherwise ^ we will keep in 
mind that this is but one study. While some revision of the conclusions of 
the literature review will be appropriate, factors will not be rejected nor 
described as "established" solely on the basis of the present study. 

Thank you. 



H- A N D 0 U T 



Wt. Corr. 

Sc(A) .66 (.81) 

Sc(B) ,77 (.82) 

Sc(C) ,56 (.69) 

0 (B) .32 (.51) 

E (D) .30 (.51) 

SD .24 (.51) 

Cs(A) .47 (.59) 

Gs(C) .77 (.81) 

0 (C) .40 (.56) 

Pe(A) .34 (.42) 

Na(B) ,32 (.48) 

SD .33 (.31) 
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Factor VIII 
Self-Conf idence 



Feels confident phvsicallv, nersonally, 
and career-wise vs • Needs encourageini^nt , 
feels inferior, afraid of failure. 

Claims to have abilities, skills, and 
good experiences vs. Claims handicaps, 
ineptitude, and unfavorable experiences, 

Percerives others as having been positive 
toward him vs , Negative. 

Credit is given by others vs. Blame by 
others is unfair. 

Life is good, life is worthwhile vs. 
l^els frustrated, dissatisfied. 

Soci^'.l Desirability 



Factor XII 

Gregariousness 

Likes to be with people physically vs. 
Lik'-s to be alone. 

Likes work or socializing with people vs, 
Lilces work alone or isolated activities. 

Depends on others for help, advice > and 
sympathy vs. Not. interested in others, 
independent . 

Persistentj persevering, determined vs. 
Quitting^ fickle, needs change, gets 
discouraged, [XVII * 30 ] 

Likes success in competition, likes 
getting ahead vs. Dislikes competition, 
[XXI .30] 

Social Desirability 
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Oni(a) 



Om(B) 



Om(C) 

To(C) 
EmCO 
Ag(D) 
Se(A) 
SD 



Wt. 
.87 



79 



.48 



56 



.47 



.42 



.41 



.22 



Corr. 
(.86) 



(.80) 



(.59) 

(.83) 
(.61) 
(.52) 
(.54) 
(.52) 



Factor IX 
Open-Mlnded 



Re] ieves manv different philosophies (religious 
or political views) can be reasonable vs. Rigid 
belief in one plii losophy , no tolerance uf com- 
promise . 

Respect for and interest in the religious and 
political philosophies of other people vs. 
Strong belief in the rightness or wrongncss 
of principles. 

Innovative, readiness for new ideas, flG!xihle, 
foresighted vs. Highly conservative, conventional, 
2nd unchangeable In ideas. 

Tolerant of human nature vs. Cynical about human 
nature . 

Satisfied, cooperates with authority vs. Asserts 
independence from authority, stubborn. [XXI .30] 

Trustful, confides in people vs. Suspicious, keeps 
distance. [X.30] 

Warm, soft, cooperative, kind considerate vs. 
Hard, stern, bossy. [XXIII .42] 

Social Desirability 
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Factor il 

Poise, Sociability vs. Self-Consciousness 



?o(A) 
?o(B) 

Po(C) 

So(A) 

So(B) 

So(C) 
Do (A) 
SD 



Wt. 
.82 

.79 

.39 

.60 

.55 

.76 
.31 
.0^ 



Corr. 
(.86) 

(.82) 

(.51) 

(.75) 

(.69) 

(.80) 
(.56) 
(.30) 



Enjoys group attention, exhibitionistic, poised 
vs. Dislikes being in front of people. 

Enjoys r:;rforTring in public, feels oride in 
speaking to a group vs. Dislikes performing 
in public. 

Seeks comment and attention from important 
people vs. Self-conscious with superiors, 
avoids criticism . 

Competent socially , social organizer, enj oys 
. ttention vs. Withdrawn, fears public speak- 
ing and social resDonsibilities . 

Glib talker, has superficial social know-how 
vs. Aloof, doesn't know or care what should be 
said. [XVIII .36] 

Hardened socially, confident in social con- 
tacts vs. Shy, socially insecure. 

Takes charge socially, wants power vs. Sub- 
missive, willing to serve. 

Social desirability 
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Factor III 
Self-Suf f iciencv--Emot:ional 



Ss(A) 



Ss(R) 

Ss(C) 

Ss(D) 
To(E) 
Na(A) 
SD 



Ss(A) 

Ss(B) 

Ss(C) 

Ss(D) 
Na(C) 



Wt . 
.98 



.03 



.03 



.62 



.38 



.35 



.07 



.03 



1.03 



.39 



.17 



-.43 



Corr. 

( . 91 ) Sel f-suf f icient , likes to be alone in st re55s , i n 

planning, in facing nroblems, makes own plans, dis- 
likes being served, self-reliant, decisive vs. Dep- 
endent, needs help from others, group dependent. 

(.25) Desires to be different, individualistic,, free vs. 

Needs approval of others, conforms, accepts social 
order, agrees with group, likes affiliation, complies 

(.15) Unusual ideas, unconventional, idealistic, ref-- 

lective vs. Has majority opinions, tends lo tiave 
same feelings as others. 

(.64) Emotional independence vs. Needs love, friends, 

succorance, and protection. 

(.41) Tolerates the imperfections in things vs . Peels 

hostility toward things that fail to work [XXlll . Al ] 

(.43) Likes to do his best, works hard, persists until 

successful vs. Play before work. 

(.22) Social Desirability 

Factor V 
Self-Suf f iciency — Nonconformity 

(.28) Self-sufficient, likes to be alone in stress, in 

ulanning, in facing problems, makes own plans, dis- 
likes being served, self-reliant, decisive vs. De- 
pendent, needs help from others, group dependent. 

(.98) Desires to be different, individualistic, free vs. 

Needs approval of others, conforms, accepts social 
order, agrees with group, likes affiliation, complies 

(.44) Unusual ideas, unconventional, idealistic, reflective 

vs. Has majority opinions, tends to have same feel- 
ings as others. 

(.28) Emotional independence vs. Needs love, friends, 

succorance, and protection. 

(-.48) Strives for accomplishment, wants to produce some- 
thing great vs. No motivation to do good or to help 
people . 



SD 



-.05 



(-.22) Social Desirability 
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Factor VI 
Thought fulness — Extraspec tive 

Wt- Corr. 



T(A) 


.17 


(.^1) 


T(B) 


■ .33 


(.53) 


T(C) 


-.04 


(.16) 


T(D) 


1.10 


(.95) 


SD 


.01 


(.32) 



Likes to think, reflect, meditate vs. Pre- 
vented from doing it by social or business 
activity. 

Likes to think about people or with people 
vs. Enjoys the company of people without 
analyzing them. 

Thinks about self vs. Carefree about self. 
Intellectual interests vs. Active interests 
Social Dasirability 



T(A) 


.44 


(.48) 


T(B) 


.18 


(.31) 


T(C) 


1.01 


(.95) 


T(D) 


-.06 


(.10) 


SD 


.09 


(.08) 



Factor XXII 

Thought fulness — Introspective 

Likes to think, reflect, meditate vs. Pre- 
vented from doing it by social or business 
activd ty . 

Likes to think about people or with people 
vs. Enjoys the company of people without 
analyzing them. 

Thinks about self vs. Carefree about self. 
Intellectual interests vs. Active interests 
Social Desirability 
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Re (A) 
Ca(A) 

Ca(B) 

Au(a) 
Au(B) 

E(A) 

De(B) 

De(C) 

Co (A) 

Wb(A) 
Wb(C) 



Factor I 

Calm, Relaxed vs . Worried , Nervous 
Wt. Corr. 

.88 (.84) Physically relaxed vs. Fidgets, has nervous 

habits , tvjitches , has restless movement s , 

.82 (-84) Relaxed, stable, at ease vs. Anxious, worried 

(about self), edgv, uneasy, nervous, tense, 
restless (without cause). 

.34 (.64) Takes time to think, deliberate vs. Overreacts, 

impulsive, j itterv [XXITI .51] 

-.31 (--52) Daydreams vs. Has practical thoughts [XVI -,33] 

-.62 (-.84) Anxiety and worry that leads to autistic 

thinking vs . Relaxed, adjusted , realist Ic 
thoughts [XVII .32] 

-59 (.76) Emotionally stable, tolerant, stolid vs. 

Emotionally sensitive, irritable [XIV -.34] 

.33 (.54) Dependable, punctual, keeps promises vs. Care- 

less about promises and details. [IV .47] 

.41 (-62) Self-sentiment control, control of own feel- 

ings vs. Actions and thoughts are swayed by 
emotions . 

.38 (^60) Concentration on study or reading, restraint 

leading to maintenance of attention vs. Mind 
wanders , bored , forgets names . 

.32 (.65) Has feeling of well-being, happy, vs. De- 

pressed, blue , lonely* 

.34 (.64) Confident, can stand criticism vs. Guilt prone, 

feels worthless and spurned, worries about him- 
self. 



.23 



(.60) 



Social Desirability 
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Rt(A) 
Rt (B) 

Rt(C) 

De(B) 

Ag(A) 

SD 



Wt. 
.34 
.65 

.00 

.47 

.36 

.03 



Corr. 
(.52) 
(.70) 

(.28) 

(.62) 

(.48) 

(.27) 



Factor IV 
Restraint vs. Rhathymla? 

Planning vs. Acting without thought, impulsive. 

Serious, responsible vs. Lively, carefree, irre- 
sponsible, no thought of the future. 

Enjoys stable pursuits vs. Wants excitement, 
change, wildness . [X .33; XVI .36] 

Dependable, punctual, keeps promises vs. Care- 
less about promises and details. [I .33] 

Interested in people's welfare, helpful vs. 
Prefers making lone intellectual contributions. 
[XIX .41 J 

Social Desirability 



Pe(a) 
Pe(B) 
Pe(C) 
Me(A) 

Au(B) 

SD 



Factor XVII 

Persistence — Met iculousness 

.30 (.48) Persistent, persevering, determined vs. Quitting, 

fickle, needs change, gets discouraged. 

.06 (.03) » Likes stable tasks, interests are stable vs. 

Likes changing tasks, interests change. [XX 1.09] 

.59 (.69) Conscientious, careful, exacting, tidy, orderly 

vs. Relaxed, carefree, nonchalant. 

'52 (.62) Meticulous, orderly, neat, careful, particular 

about personal effects vs. Messy, careless, 
impulsive . 

.32 (.06) Anxiety and worry that leads to autistic think- 

ing vs. Relaxed, adjusted, realistic thoughts 
[I -.62] 

.07 (.33) Social Desirability 



ERIC 
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Wt. Corr. 

Mo(B) .98 (.93) 

Au(A) -.38 (-.48) 

Kt(C) .36 (.56) 



SD 



•08 (.31) 



Factor XVI 
Moral vs • Hedonistic 



Moral, knows right from wrong, resists tempta- 
tion vs. Pleasure seeking. 

Daydreams vs. Has nractical thoughts [I -.31| 

Enjoys stable pursuits vs. Wants excitement, 
change, wildness [X .33] 

Social Desirability 



Mo (A) 



0 (A) 



.68 (.75) 



.40 (.55) 



Em(C) .30 (.50) 



Na(B) .30 (.40) 



To(B) .30 (.40) 



SD .07 (.36) 



Factor XXI 
Adjusted to Society 

Law-abiding, obedient, well-manr ered , patriotic 
vs . Free progressive , liberal . 

Objectivity and fairness attributed to others 
vs. Paranoid delusions about others [VII -.38] 

Satisfied, cooperates with authority vs. Asserts 
independence from authority, stubborn. [IX .47] 

Likes success in competition, likes getting ahead 
vs. Dislikes competition. [XII .32] 

Believes people are capable of good work vs. 
Critical , fault finding. 

Social Desirability 



ERIC 
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Factor VII 
Intolerant of Situations? 



Wt. Corr. 



Do (A) .10 (.13) Takes charge socially, wants power, vs. Sub- 

missive, willing to serve. 

Do(B) .21 (.23) Egoistic, pushes own ideas vs. Respects others' 

ideas , self-effacing . 

Do(C) 1.02 (.96) Rights-conscious, comolaining vs. Tolerant. 

Re(B) -.42 (-.53) Tolerant of physical, non-human or situational 

annoyances vs. Irritated by mishaps and frustrat- 
ing circumstances . 

0 (A) -.38 (--53) Objectivity and fairness attributed to others vs. 

Paranoid delusions about others. [XXI .40] 

SD .11 (.31) Social Desirability 

Factor XIII 

Dominance? 

Do(A) .23 (.32) Takes charge socially, wants power vs. Sub- 

missive, willing to serve. 

Do(B) .75 (.78) Egoistic, pushes own ideas vs. Respects others' 

ideas, self-effacing . 

Do(C) .10 (.15) Rights-conscious, complaining vs. Tolerant. 

Re(B) .33 (.35) Tolerant of physical, non-human or situational 

annoyances vs. Irritated by mishaps and frustrat- 
ing circumstances . 

SD .04 (.09) Social Desirability 
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Wt. Corr. 

To(A) .90 (.82) 

Ca(C) .50 (.60) 

Ag(n) .30 (.45) 

SD .12 (.46) 

Ca(B) .51 (.64) 

Se(A) .42 (.52) 

To(E) .41 (.56) 

SD .07 (.36) 



Factor X 
Optimistic about people? 



Naive, impunitive, believes people are hone^^t 
and fair vs • Bel i eves peop 1 e lie and are uii i r 
to gain an advantage. 

Confident about the world vs. Having fears or 
worries about outside influence«^. 

Trustful, confides in people vs. >Susnicious5 
keeps di stance [IX .42] 

Social Desirahili ty 



Factor XXIII 
Gentleness 

Takes time to think, deliberate vs. Overreacts 
impulsive, jittery. [I .34] 

Warm, sof t , coonerative, kind, cons iderate vs . 
Hard, stern bossy. [IX .41] 

Tolerates the imperfections in things vs. Feels 
hostility toward things that fail to work. 
[Ill .38] 

Social Desirability 
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Wt. Corr. 

E (C) .60 (.72) 

So(B) .36 (.«4«4) 

Ac (A) .32 (.39) 

Ac(C) .33 (.52) 



SO 



.09 (.34) 



Factor XVIII 
Energet ic, Vigorous 



Healthy, feels vigorous, vs. Tired, inter- 
mittent loss of energy, hypochondriacal . 

Glib talker, has superficial social know-how 
vs. Aloof, doesn't know or care what should 
be said. [II .55] 

Moves rapidly, quick in physical performances 
vs. Slow. 

Accomplishes things rapidly vs. Irdolent, un- 
motivated. [XV .30; XXI .32] 

Social Desirability 



Mo(C) .68 (.70) 

Ag(A) .41 (.48) 

SD -.03 (.05) 



Factor XIX 

Generous , Helpful 

Generous, helpful, fair gives to causes vs. 
Selfish, uncharitable . 

Interested in people's welfare, helpful vs. 
Prefers making lone intellectual contributions, 
[IV .36] 

Social Desiribi li tv 



Em(B) 



,90 (.90) 



Factor XI 
Specific 

Modest, shuns attention, outwardly directed 

vs. Self-centered, seeks attention, egotistical. 



SD 



,06 



(.16) Social Desirability 
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Wt. Corr. 

Su(A) .74 (.86) 

E (A) -.34 (-.15) 

SD .14 (.35) 

Su(B) .94 (.94) 

Ac(C) .30 (.42) 

SD .03 (.25) 

Pe(B) 1.09 (.93) 

SD -.09 (-.37) 



Factor XIV 

Specif i c 

Exuberant, enthusiastic, cheerful vs. He- 
pressed, reserved , inhibited. 

Emotionally stabl e , tolerant, stolid vs . 
Emotional] V sensitive, irritable. [I . ^'^l 

Soci al Desirabili ty 

Factor XV 
Specific 

Likes to stimulate and cheer up people vs 
Ouiet stay at home. 

Accomplishes things rapidlv vs. Indolent, 
unmotivated, [XVIII .33; XXI .32] 

Social Desirability 

Factor XX 
Specific 

Likes stable tasks, interests are stable 
Likes changing tasks, interests change. 

Social Desirabili ty 



Factor Reference Kits and Personality Structure Theory 

Raymond B. Cattell 
Institute for Research on Morality and Adiustment 
Boulder, Colorado 

I think my title sufficiently indicates the main premise of my position, 
na: '^ly, that no one in liis psychological senses would undertake the labor of 
constructing a reference scale unless he had first ascertained the natural 
personality structure to which it refers and from which it draws Its validity 
evaluation. This position makes test construction something more than 
psychometrics ; in fact it becomes an integral part of research on personal- 
ity theory. Psychologists nevertheless fall into two groups according to 
the pole of this relationship at which they stand. To the psychometrist the 
test or means of measurement is the thing and the personality trait structure 
is just the means of conceptually validating his test. To the personality 
theorist, on the other hand, the hypotheses of Lrait structure are primary 
and the test is merely one of several operational bases for his theory. My 
affiliations are with the second group 5 and when I develop a scale for anxiety 
surgency, premsia or ego strength in the 16 P.F. or HSPQ this scale is a 
hostage which I hand over to other psychologists as an earnest of the truth of 
my trait theory and an operational base whereby they can test it. 

This difference of emphasis has, of course, many associated differences. 
For example, the theorist will "^ant evidence that his structures exist in the 
other two media of observation beyond Q-data, namely in L- and T-data; that 
is in ratings and in objective, laboratory tests, and he will want evidence of 
unitary structure in trait growth, such as is now coming in through differerti 
R factor analys. In regard to the former we are passing through a period of 
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skepticism, but I am about to publish some extensive result showing that: 
if sound ratings and questionnaire measures arc factored together c!;o x;'"^. 
structures indubitably appear provided the intruding instrument i.actor.- 
are cle.arlv t.-.^t aside. Incidentally, since in this brief prcsc nt.a l i o/. ^Mc-t* 
t-rt: at least four points at which I shall invoke massive data whi..ii launot: 
be presented here, it is fortunate that I can refer you to a single sunuiiariz- 
ing source. This is my book. Personality and Mood by Q^uestionnaire , appearing 
this fall from Jossey -Bass at San Francisco, with nearly a hundred summ.ir izi^.^, 
tables and calculations. 

I have just suggested that the proper beginning in psychometri cs is 
the marriage of tiie right test scale with the right factorially unitary trait 
structure; but as in marriage generally a good beginning isn't everything. 
Very few people in the test construction game seem to have realized that it 
takes many years to groom a scale to maximum compatibility with a given 
personality factor. In the last two or three years various publications have 
appeared claiming to establish a factor scale on one or at most two factor 
analyses. Even if these factor analyses were cechnically good, which I can 
show they have not been, this cannot be done. The reasons are first that 
single items change their meaning to a significant degree with changes of 
population and secondly that estimates of one and the same factor score, used 
as the criterion in item analysis, correlates relatively roorly, according to 
the items used in estimation. It has taken just twenty-five years, since the 
first definition of the 16 P.F. primary structure by Dave Caunders and myself, 
to the T»roduction of the present day 16 P.F. with foui equivalent scales for 
each factor. In that time some fourteen factor analyses of the domain have 
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been made using what I have defined in my book as the principle of pro- 
gressive rectification, alternating item and scale factor analyses and 
shifting across different types of population. Incidentally, though the 
ideal of finding items that have transferability across populations is 
necessary for an all-purpose test, it has never been fully achieved. For 
example, our recent comparison of 16 P.F<. item validities on a mature 
adult population and an undergraduate population shows that on the superego 
factor G and the radicalism factor this twenty-five year search for good 
markers has still left us with items good on one group and not on another. 
The factor persists but the items change with time and population. 

In this somewhat unstable world the married scale and factor perform 
a mutual service of progressive rectification, in years of programmatic 
research. Having said this I am now going to dwell somewhat more intensively 
on the personality structure side, taking it for granted that if the structure 
is well defined the busy psychometrist will sooner or later produce good 
scales. If I am asked what I consider this structure to be I can answer best 
by a brief reference to history into the psychologists involved. The first 
factored questionnaire scales came out in the late forties by Guilford, 
Thurstone and myself. Since Thurstone re-rotated in Guilford's space I can 
speak essentially of the G-Z and the 16 P.F., indicating the number of primaries 
in the stratified personality sample of items to be in the region of 12 to 18. 
The number in the observer rating domain was fewer, about 12, but in more 
recent work I have shown that with thorough ratings it climbs close to the 
same number as for Q-data. In pursuing Q-data analyses over different age 
ranges and population my coworkers became aware of factors only intermittently 
visible and hence not included in the 16 P.F. which we came to call the seven 
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missing factors. A concentrated search for them in the last ten vear? by 
Delhees, Marshall and DeVoo^"!, liowever, has confirmei these sevon ani^ or<»- 
duced two equivalent scalef^ for each. 

Wjj are cruiS todav talking about 23 primary factors among which som%,' 
^ or 10 seroaJ orders, such as anxiety, exvia, cortertia, etc., have been 
replicated several times. But this is only in the domain of normal items 
and if we throw in the substance of various pathological behaviors, in- 
cluding the MMPI we find 12 abnormal primaries beyond the 23 of the extended 
16 P.F. The Clinical Analysis Questionnaire, for which Dr. Sells and I are 
now constructing an equivalent B form, thus has no fewer than 28 primary 
factors and 12 second orders. 

But while this programmatic, interlocking research by many collaborating 
investigators, using common markers and sophisticated factor analytic methods 
has been going on, other quite dissident views about personality structure 
have appeared. Eysenck has widely publicized scales claiming to cover per- 
sonality with only 3 factors; Comrey has about 8, Norman in the rating field 
stops at 5, Howarth's scale has 10, and so on. Not only do they wander all 
over the place as to the number of factors, despite a roughly common item 
foundation, but their rotations result in differing patterns for which no 
congruence coefficients show any substantial agreement. 

Vaughan has an article unfortunately still in press inspecting the 
technical procedures of these researches and I have been moved to do the same 
in a spot-check reported in my forthcoming book. In this latter I have set 
out for the reaction of the factor analytic world, eight conditions which seem 
vital for a factor analysis the results of which one would take seriously. 
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They include, besides good sampling of people and variables, a test for 
the number of factors, a use of estimated communalities instead of unities, 
an objective blind rotation to maximum oblique simple structure, a test of 
statistical significance of the simple structure reached and a check on 
invariance across researches by the congruence or salient variable similarit^^ 
coefficients among the factor patterns. It turns out that fifths of the 
researches published between 1968 and 1973 and quoted as unsettling the 
conclusions I have just given fail on two or more of these requirements. 
Even failure on one, such as number of factors, suffices to ruin the con- 
clusions. This question of technical care is vital because in hardly any 
other place in psychology do we go through so many processes between the 
data and the final conclusions as in uniquely rotated factor analytic 
solutions . 

Since an error at the first decision point — that for number of 
factors — accounts already for the majority of the studies deviating from 
our programmatic conclusions. I obviously give an account of why my labor- 
atory has rested on the scree test for the number of factors. Though I have 
offered a theoretical basis for it in my 1966 article, and Tucker has 
valuable statistical arguments for his closely similar procedure I am prepared 
to take my stand for it entirely on empirical grounds. Over a dozen plasmodes 
that is, correlation and score matrices built from a known number of factors — 
have yielded tr.e correct number of factors when examined by the scree, without 
a single failure. And in two instances where we went to the expense of 
running the full maximum likelihood analysis, on which I think we can all 
agree, the result of the scree and the likelihood method concurred. 
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By these tests the number of factors in the 184 to 500 items defining 
the personality sphere in the 16 P.F. is around 20 (or 23 if the missing 
factor markers are included) the largest and most stable 16 of which are 
scored as 16 P.F. scales. If this is correct, Howarth's 10 from the same 
data is a bad underf actoring ; those settling on 5 to 8 are statistically 
deluded, and Eysenck's holy trinity can have only religious rather than 
statistical significance. However, I think we can throw some light on what 
the resultant scales are. By rotating underf actored plasmodes DeYoung and 
Finkbeiner, independently have shown that the factors thus reached, inci- 
dentally rather deficient in simple structure, are rough approaches to 
second order factors, (that is to say to second orders projected on items, 
or "grounded" as we say). But the emphasis is on rough, especially if the 
underf actoring is severe, and Barton's recent work shows that the Eysenck 
and Comrey scales have lower and contaminated factor validity compared to 
those in the CTS Kit deliverately item analyzed against second orders 
located from the full roster of primaries. 

As every factor analyst knows, although one cannot rotate to good 
results on the wrong number of factors, it is still possible to go grievously 
astray in rotation even when one has passed the first hurdle and began with 
the right number- My coworkers and I have written so many articles on the 
problems, canons and programs of rotation that I can add nothing here except 
a word of warning against a current epidemic. I refer to the epidemic of 
factor resolutions by lazy push button use of alleged simple structure dis- 
covering analytical programs. The rationalization is that these must be 
more objective and correct than anything humanly guided. It is as if someone 
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demonstrated the superiority of the machine by pushing the self starter and 
jumping out as his car started moving. Analytical automatic programs, but 
not topological automatic (of which the only representative is maxplane) 
have never been given the right mathematical functions and so re'^iably 
deliver the wrong answer. Finkbeiner and I have recently shown that in 
most well planned factor analytic studies the count that should be maximized 
is that of variables in the +,05 band, not +.10 or +.15. Analywical 
programs, but not maxplane or rotoplot indiscriminately capitalize on gains 
in low loadings and high loadings, regardless of the required hyperplane 
width. In five years I have not encountered an analytical solution the 
+.05 hyperplane of which I could not improve by blind rotoplot hand rotations, 
with unmistakable change in the resultant meaning and sometimes matching of 
the factor. 

?or someone who set out by saying that his main concern was to guide 
scale construction by personality theory I may seem to have spent a lot of 
time on factor analytic technicalities. But until we conduct something like 
an anti-pollution crusade, calling for serious application of the widely 
agreed but not widely practiced canons of factor analysis, the part of theory 
that comes from this foundation is going to be contaminated and misleading. 
I say part of theory for, as I said initially, the verification and extension 
of structural concepts from factor analysis rests on many other techiTlques . 
For example, we now have evidence from well stratified samples, independently 
in America and Britain, of the age trends on 16 P.F. primaries and secondaries 
from about 10 to 70 years o' age. On these curves one observes that of the 
four primaries which enter the exvia secondary, surgency declines s.^aeply 
from 20 to 40, affectia and parmia rise and self-sufficiency stays level. It 
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is on such a basis, and the superior multiple correlations with various life 
criteria, for example, achievement creativity records, that I would argue, 
in contrast to Eysenck and Comrey, that the primary personality structures 
have greater psychological unitariness and functional reality than the 
secondaries. Personality theory, as distinct .rom psychometrics , cc aid thus 
come to the conclusion that the secondaries are only patterns arising in 
primaries through relatively incidental social status or other influences 
bringing some joint selection on primaries. 

To take another quick and concluding illustration from the many ways 
in which .he impact of personality theory on scale construction could be 
studied, I would mention that the psychological conception of a broad temper- 
ament trait like affectia or a broad dynamic organization trait like ego 
strength calls for a lower degree of item homogeneity in good scale con- 
struction than straight psycbometr ists are usually willing to take. The 
truth about trait structure lies midway between those psychometrists who 
obsessively seek highly homogeneous scales, and those experimentlists , e.g., 
some Skinnerians, who think all is specificity of conditioning. A primary 
source trait should have its items widely sampled from life areas, foregoing 
the false goal of homogeneity which can be easily attained by introducing 
semantic instrument factors; that is, by asking the same questions in ten 
different synonyms. By wide behavior sampling the mean inter-item correlation 
in a typical 16 P.F. scale has been kept down to 0.1 or less, with a mean 
item-factor validity of 0.3. Yet with only 13 items the weighted scale score 
gives a validity of about 0.8 against the factor. It is in matters like this 
that personality theory and classical itemetric theory set different standards. 
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And I would add that the need for enriching the itemetric approach to psycho-- 
metrics by superordinate directives from personality theory becomes even more 
imperative when we extend from temperament to dynamic traits and from traits 
to psychological states. 

Finally in this interdependence of scales personality const rue ts I come 
to the question of naming the now quite enriched concepts embodied in each 
personality factor. From the beginning of my factoring of personality dimensions 
— and this goes back to two articles published in 1933 — I have encouraged 
psychologists to use a nor-committal but agreed symbol for each factor as it 
becomes sufficiently replicated. Thus arose the A, B, C, D, etc., notation 
for questionnaire factors and the universal index, U.I., numbers which researchers 
in several countries now use for the objective test factors. The object of 
the non-committal s5nnbol is to distinguish the undoubted pattern from the 
questionable and possibly temporary interpretation which a verbal label would 
imply. This has worked well but we are now coming to a ripeness of theory, 
as I trust I have shown in my book, Personality and Mood by Questionnaire , 
where if we are to escape the confusing associations and vaguenesses of popular 
terms we must, like chemists or physicists, use our own technical terms. That 
is why I have called factor A, affectia; B, intelligence; C, ego strength, 
G, super ego strength; M, autism, and so on. In short, if theory and scale 
construction are to be brought together it is time for psychometrists to begin 
taking theory seriously. The decision to hypothesize that, for example, C is 
ego strength, is based on its being the factor which is significantly low in 
all forms of psychopathology ; on its normally rising steadily with age; on its 
loading substantially the second order factor of anxiety; on its being high in 
occupations, such as commercial airline pilots, requiring emotional control and 
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steadiness; and on its rising significantly with successful therapy. A 
similar process of scientific inference has gone into the tenative naming 
cf other factors, and I think that after watching 20 to 30 years of care- 
fully set out theoretical development anyone with a feeling for the history 
and tenets of science realizes that the time has come for respecting these 
more theoretically meaningful titles. Vague popular terras for these 
factors like sociable, emotional or friendly will get us nowhere except 
into a Tower of Babel. I am not suggesting that terras from programmatic 
personality research be considered sacrosanct and permanent. But while the 
index numbers hold the pattern identity at a descriptive level, the carefully 
chosen labels given by those long programmatically researching on personality 
structure express a precise theory. If the theory proves wrong they should 
be re-named, as alpha particles were renamed when the nature of protons and 
neutrons became clear. But it is an inevitable part of the progress we are 
making in relating reference scales to personality theory that those scales 
should receive scientifically meaningful technical rather than merely popular 
names, and that these names should provoke theoretical discussion and sometimes 
a need for amendment. These points and the index system which at least forty 
investigators here and abroad have used since I made in my 1957 book on 
Personality and Motivation Structure and Measurement and have continued more 
responsively to findings on primary and secondary trait and state patterns 
since in my present book on Personality and Mood by Questionnaire . 

The call by Dr. Goldberg for a thorough definition of the personality 
sphere and that by Dr. Harman, Dr. Dermen, and Dr. Fiske in terms of instrument 
factor design, for expert and well planned use of factor analysis, as well 
as the life long work of Dr. French and Dr. Royce in organizing findings and 
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pointing to gaps in the system have made possible today the transition I 
have just been discussing from a rank growth of arbitrary questionnaires to 
a scientifically recognizable set of reference scales, functionally related 
to personality structure theory. After a long and exacting period of care- 
fully interlocking, programmatic research we are at last close to a universally 
accepted set of measures on which developmental and other personality research 
can firmly move forward • I would suggest in closing as I did in opening that 
this firm ground will be achieved only by greater regard for basic factor 
analytic technical standards on the one hand, and, by interest in theoretical 
interpretations from the wider field of personality research on the other. 



Summaries of Discussants 



Joseph R. Royce 
The Universitv of Alberta 
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Factor Invar iance 

The major issue at the heart of this symposium is the problem of 
factor invariance. It happens to be the big issue in substantive factor 
research — and, unless the factor methodologists resolve it, the factor 
approach may not fully achieve its enormous potential. 

French's analysis shows, by concrete examples, the practical diffi- 
culties involved in factor invariance . The essence of the problem is: 
"Are we talking about the same factor?*' 

More abst ractly, this issue can be summarized via the following 4— fold 
table: 

Subiects 
Same Dif f . 



C/3 
0) 



tT3 



Same 



Dlff . 



I 


II 


III 


IV 



Of course when the subjects are the same and the variables are the same no 

issue arises regarding factorial invariance. The degree and scope of the 

invariance issue can be viewed as follows: 

Case I Reliability 

Case II I Resolvable 

- > Sampling 
Case III J Problems 

i 

Case IV Apparently Impossible 
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Quantitative resolution of Case 'IV is apoarently impossible to solve due 
to insufficient information. However, Case is the most typical case. 
The only hope at present is via long-range programmatic e mp Iri cal research, 
in accordance with Cattell^s guidelines, and as exemplified hy HermenVs 
study. This procedure involves empirical checks on hypothesized factors 
which are identified a nriori bv '^marker variaHles". 
Questions for the Symposium Participants 

Drs . Cat tell and Harman: Suppose we allow for the semi Utopia via 
Cattell's eight criteria, and, further, let us grant that this would in- 
crease the probability of identifying invariant factors. My question is. 
Wouldn't we still have a difficult time of it, and wouldn't a quantitative 
solution for Case IV still be impc^ssible? (i.e., the case where we are 
wondering whether we're talking about the same factor in spite of differ- 
ences in the sampling of subjects and measurements). Could vou also comment 
on whether it would be scientifically valid and/or desirable to set up an 
International Bureau of Measure- " its (e.g., via the International Union of 
Scientific Psychology) which would constitute a Scientific World Court to 
rule on Universal Index factor constructs. It is my opinion that a procedure 
such as this is needed, and that it is, in fact, in accordance with precedence 
in other scientific disciplines. 

Drs. French and Dermen: UHiy did you compose completely new items for 
each hypothesized factor? \^y did you not at least retain the old items as 
"markers^^? Also, would French be good enough to elaborate on the oblique- 
orthogonal rotation point on page 5 of his manuscript. This surprises me. 

With regard to language and personality traits, I have two questions., 
the first is for anybody on the panel, while the second question is for 
Dr. Goldberg (and possibly Dr. Cattell) . If we begin with the oremise that 
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the relationships between language and behavior are somewhat tenuous — 
then: 

(1) How is it that we get replicable factors at all via the 
generally weak data base of self-report personality question- 
naires? 

(2) It is my understanding that the Cattell-Odbert study of 30 years 
ago was conducted as a pilot study which was replaced by more behavior 
oriented investigations. Since there is considerable extrapolation re- 
quired between '^linguistic preferences" and ''traits inferred from be- 
havior/' Why are you so optimistic about language as the route to 
personality traits? 



Donald W. Fiske 
University of Chicago 

The work of Goldberg, Norman, and Peabody on a descriptive taxonomy 
should prove valuable. It will show us how human beings perceive and construe 
each other in the everyday world. It will bring out our implicit personality 
theory, the personality taxonomy of the English-speaking world, and also of 
those speaking other languages. Perhaps that is all we should look for in 
this domain we ca 1 personality: perhaps conventional personality refers to 
nothing but how people see people. 

KT-iile John French's critical integration of .revious factor analvses 
is needed and may prove very useful, its outcoiiie is discouraging. There are 
so many alternative ways of slicing the cake of persona?, j ' y . What factors 
are obtained from a factor analysis depends crLciallv vhat content is put 
in. While Dr , French's factors may be more comprehensive, they will still be 
rath r arbitrary. 

As scientific terms, all factor labels and all trait names are much too 
vague. It: is difficult to keep one factor separate from the next, as Dr. 
French has found. And one trait blends into the next. Factors and traits 
are verbal interpretations; all such common nouns have some fuzziness around 
the edges. Labels for factors and traits lack precise references to any 
objective behavior, other than to test responses, and each such response is 
interpretive. 

In Dr. Dermen's work, I particularly I'ke the use of separate scores 
for each pole of the dimensions beine; ir /^s-. titrated . Behavior is full of 
apparently opposed dispositions, and we neea to study their patterning. 
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One of Dr. Cattell's most important points was madv^ almost as an a^ide: 
"he meaning of an item chanties with the population tested. We don't have 
items which are transferable from one population to another, I^r. Cattell 
implies that we will eventually have such items. T am sure that we will 
never have them. In the work nf my researcli program and in published work 
b;^' others, it is clear chat an itfc.i has a different Dersonal meaning for ec*ch 
subject reaponding to it. 

More fundamentally, Dr. Cattell and 1 disagree on the metaphysics -^f 
personality. He seems to believe that self-ieport questionnaires can help 
us find out what the one underlying structure of personality really is. T 
don't believe that there is such a single structure to be found. All we are 
studying is the way people construe their perceptions of other people and of 
themselves. In individual difference work, almost all person^^.litv daca are 
verbal statements, almost all personality data are the labelling or the inter- 
pretive observations of someone* On almost no personality data do observers 
agree perfectly with each other. Almost no personality data involve discrete, 
separate behavioral acts. 

So let us be clear about what we are doing. We are not studying the 
underlying reality, the behavior of people; wu are studying the way people 
summarize their experiences with other people. This distinction is more than 
pedantic carping. The large step between behavior and what v/e study has been 
brought out by an anthropologist who has been doing psychological research. 
D'Andrade has shown that when a set of behaviors are scored from immediate, 
direct observations, their intercorrelat ions are much 'ower than those be- 
tween ratings made after observing the behaviors, i.e., from memory of what 
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was observed a few minutes earlier. Moreover, the pattern of intercorrel.a- 
tions among the latter ratings, made after the observation period^ approxi- 
ates all too closely the pattern obtained quite independently from similarity 
judgments, when subjects are asked to indicate how similar each behavioral 
disposition is to e\/ery other one. 

All self-report questionnaires and most other personality data call on 
an observer's memories. Usually, these are memories of events long past, not 
just memories of experiences occurring a fev7 minutes ago. Such data are not 
even derived from interpretations of single acts.. Each datum, each observer's 
response, is an interpretation of memories which have had considerable time 
to be transformed from the original perceptions. We need an explicit theory 
of the process by which a person summarizes, in the form of attributions, his 
experiences and perceptions of himself and others, and the process by which 
he stores and retrieves those attributions. 
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